Max level shown:
1 [ Nov 21 01:16:58 Enabled. ]
2 [ Nov 21 01:16:58 Rereading configuration. ]
3 [ Nov 21 01:16:59 Rereading configuration. ]
4 [ Nov 21 01:17:07 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 21 01:17:07 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-21T01:17:07.825ZDEBGnexus: registered DTrace probes
82024-11-21T01:17:07.827ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-21T01:17:07.836ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-21T01:17:07.837ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-21T01:17:07.837ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-21T01:17:07.855ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-21T01:17:07.858ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-21T01:17:07.861ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-21T01:17:07.868ZDEBGnexus (ServerContext): registered USDT probes
672024-11-21T01:17:07.901ZINFOnexus: Database schema version is up to date desired_version = 114.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 114.0.0
682024-11-21T01:17:07.904ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
692024-11-21T01:17:07.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1006, tv_nsec: 804468624 } })
702024-11-21T01:17:07.905ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
712024-11-21T01:17:07.964ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
722024-11-21T01:17:07.964ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-21T01:17:07.966ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9ced63d-b57c-4f84-987d-acd14de4cae9", "content-length": "26", "date": "Thu, 21 Nov 2024 01:17:07 GMT"} })
742024-11-21T01:17:07.966ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-21T01:17:07.967ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-21T01:17:07.997ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1006, tv_nsec: 897626176 } })
772024-11-21T01:17:07.998ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
782024-11-21T01:17:08.035ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
792024-11-21T01:17:08.035ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-21T01:17:08.035ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65d92880-3c9c-4f78-a2ed-7d3e19d5618e", "content-length": "26", "date": "Thu, 21 Nov 2024 01:17:07 GMT"} })
812024-11-21T01:17:08.035ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-21T01:17:08.036ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-21T01:17:08.111ZDEBGnexus (clickhouse-client): registered USDT probes id = c4b4ef0d-65f9-4a18-aad5-7dfbb3aab91b
842024-11-21T01:17:08.111ZDEBGnexus (clickhouse-client): registered USDT probes id = c4b4ef0d-65f9-4a18-aad5-7dfbb3aab91b
852024-11-21T01:17:08.119ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-11-21T01:17:08.132ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-11-21T01:17:08.133ZDEBGnexus (DataLoader): attempting to create built-in users
882024-11-21T01:17:08.133ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892024-11-21T01:17:08.133ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902024-11-21T01:17:08.146ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
912024-11-21T01:17:08.146ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
922024-11-21T01:17:08.147ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
932024-11-21T01:17:08.148ZDEBGnexus (DataLoader): attempting to create built-in roles
942024-11-21T01:17:08.148ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
952024-11-21T01:17:08.148ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
962024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
972024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
982024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
992024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
1002024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
1012024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
1022024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
1032024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
1042024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
1052024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1062024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1072024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1082024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1092024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1102024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1112024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1122024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1132024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1142024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1152024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1162024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1172024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1182024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1192024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1202024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1212024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1222024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1232024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1242024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1252024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1262024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1272024-11-21T01:17:08.148ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1282024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1292024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1302024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1312024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1322024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1332024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1342024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1352024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1362024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1372024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1382024-11-21T01:17:08.149ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1392024-11-21T01:17:08.149ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1402024-11-21T01:17:08.149ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1412024-11-21T01:17:08.149ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1422024-11-21T01:17:08.151ZWARNnexus: Cannot look up rack: Object (of type ById(e0f91ea1-f368-4705-9818-7568a8475d7c)) not found: rack file = nexus/src/app/rack.rs:774
1432024-11-21T01:17:08.168ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1442024-11-21T01:17:08.168ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1452024-11-21T01:17:08.170ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1462024-11-21T01:17:08.170ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1472024-11-21T01:17:08.170ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1482024-11-21T01:17:08.171ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1492024-11-21T01:17:08.247ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1502024-11-21T01:17:08.248ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-11-21T01:17:08.249ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-11-21T01:17:08.249ZDEBGnexus (DataLoader): attempting to create built-in silos
1532024-11-21T01:17:08.249ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-11-21T01:17:08.249ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-11-21T01:17:08.516ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1562024-11-21T01:17:08.516ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-11-21T01:17:08.516ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-11-21T01:17:08.590ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-11-21T01:17:08.591ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-11-21T01:17:08.591ZDEBGnexus (DataLoader): attempting to create built-in projects
1612024-11-21T01:17:08.591ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622024-11-21T01:17:08.592ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632024-11-21T01:17:08.604ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-11-21T01:17:08.605ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-11-21T01:17:09.499ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-11-21T01:17:09.499ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672024-11-21T01:17:09.532ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-11-21T01:17:09.534ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1692024-11-21T01:17:09.535ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1702024-11-21T01:17:09.535ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1712024-11-21T01:17:09.578ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722024-11-21T01:17:09.578ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732024-11-21T01:17:09.580ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-11-21T01:17:09.581ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1752024-11-21T01:17:09.581ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-11-21T01:17:09.582ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772024-11-21T01:17:09.698ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1782024-11-21T01:17:09.698ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-11-21T01:17:09.699ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-11-21T01:17:09.699ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1812024-11-21T01:17:09.699ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-11-21T01:17:09.699ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-11-21T01:17:09.710ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-11-21T01:17:09.710ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-11-21T01:17:09.712ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-11-21T01:17:09.712ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-11-21T01:17:10.137ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-11-21T01:17:10.138ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892024-11-21T01:17:10.139ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902024-11-21T01:17:10.139ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912024-11-21T01:17:10.141ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-11-21T01:17:10.144ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1932024-11-21T01:17:10.144ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-11-21T01:17:10.144ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-11-21T01:17:10.145ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-11-21T01:17:10.146ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-11-21T01:17:10.147ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-11-21T01:17:10.147ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992024-11-21T01:17:10.149ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-11-21T01:17:10.151ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2012024-11-21T01:17:10.151ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-11-21T01:17:10.151ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-11-21T01:17:10.152ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2042024-11-21T01:17:10.152ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2052024-11-21T01:17:10.153ZWARNnexus: Cannot look up rack: Object (of type ById(e0f91ea1-f368-4705-9818-7568a8475d7c)) not found: rack file = nexus/src/app/rack.rs:774
2062024-11-21T01:17:10.275ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2072024-11-21T01:17:10.275ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2082024-11-21T01:17:10.276ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2092024-11-21T01:17:10.276ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2102024-11-21T01:17:10.278ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2112024-11-21T01:17:10.278ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2122024-11-21T01:17:10.279ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2132024-11-21T01:17:10.282ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2142024-11-21T01:17:10.282ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2152024-11-21T01:17:10.282ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2162024-11-21T01:17:10.293ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-11-21T01:17:10.294ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-11-21T01:17:10.296ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2192024-11-21T01:17:10.297ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2202024-11-21T01:17:10.298ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2212024-11-21T01:17:10.298ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2222024-11-21T01:17:10.299ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2232024-11-21T01:17:10.299ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2242024-11-21T01:17:10.301ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2252024-11-21T01:17:10.303ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2262024-11-21T01:17:10.304ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2272024-11-21T01:17:10.304ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2282024-11-21T01:17:10.345ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2292024-11-21T01:17:10.345ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2302024-11-21T01:17:10.346ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2312024-11-21T01:17:10.347ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2322024-11-21T01:17:10.348ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2332024-11-21T01:17:10.348ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2342024-11-21T01:17:10.350ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2352024-11-21T01:17:10.353ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2362024-11-21T01:17:10.353ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2372024-11-21T01:17:10.353ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2382024-11-21T01:17:10.480ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2392024-11-21T01:17:10.480ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2402024-11-21T01:17:10.482ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412024-11-21T01:17:10.482ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2422024-11-21T01:17:10.494ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432024-11-21T01:17:10.495ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2442024-11-21T01:17:10.498ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452024-11-21T01:17:10.502ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2462024-11-21T01:17:10.502ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472024-11-21T01:17:10.502ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482024-11-21T01:17:10.579ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2492024-11-21T01:17:10.579ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-11-21T01:17:10.580ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-11-21T01:17:10.582ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-11-21T01:17:10.583ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-11-21T01:17:10.585ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-11-21T01:17:10.585ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552024-11-21T01:17:10.587ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-11-21T01:17:10.587ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-11-21T01:17:10.589ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-11-21T01:17:10.589ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592024-11-21T01:17:10.590ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602024-11-21T01:17:10.590ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612024-11-21T01:17:10.592ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622024-11-21T01:17:10.595ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2632024-11-21T01:17:10.595ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-11-21T01:17:10.595ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652024-11-21T01:17:10.596ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662024-11-21T01:17:10.597ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2672024-11-21T01:17:10.598ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682024-11-21T01:17:10.598ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692024-11-21T01:17:10.600ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702024-11-21T01:17:10.604ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2712024-11-21T01:17:10.604ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-11-21T01:17:10.604ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732024-11-21T01:17:10.624ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-11-21T01:17:10.624ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-11-21T01:17:10.626ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-11-21T01:17:10.626ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772024-11-21T01:17:10.627ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-11-21T01:17:10.627ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792024-11-21T01:17:10.629ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-11-21T01:17:10.631ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2812024-11-21T01:17:10.631ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822024-11-21T01:17:10.632ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2832024-11-21T01:17:10.745ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2842024-11-21T01:17:10.745ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2852024-11-21T01:17:10.745ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2862024-11-21T01:17:10.745ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2872024-11-21T01:17:10.754ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2882024-11-21T01:17:10.755ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2892024-11-21T01:17:10.756ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2902024-11-21T01:17:10.757ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2912024-11-21T01:17:10.758ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922024-11-21T01:17:10.758ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932024-11-21T01:17:10.760ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2942024-11-21T01:17:10.760ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2952024-11-21T01:17:10.761ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2962024-11-21T01:17:10.761ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2972024-11-21T01:17:10.763ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2982024-11-21T01:17:10.765ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2992024-11-21T01:17:10.765ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3002024-11-21T01:17:10.766ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3012024-11-21T01:17:10.775ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3022024-11-21T01:17:10.775ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032024-11-21T01:17:10.776ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3042024-11-21T01:17:10.777ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3052024-11-21T01:17:10.778ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3062024-11-21T01:17:10.778ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3072024-11-21T01:17:10.779ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082024-11-21T01:17:10.782ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3092024-11-21T01:17:10.815ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102024-11-21T01:17:10.815ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112024-11-21T01:17:10.834ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122024-11-21T01:17:10.834ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3132024-11-21T01:17:10.857ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142024-11-21T01:17:10.857ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152024-11-21T01:17:10.858ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162024-11-21T01:17:10.859ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3172024-11-21T01:17:10.860ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182024-11-21T01:17:10.860ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-11-21T01:17:10.862ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202024-11-21T01:17:10.866ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3212024-11-21T01:17:10.866ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-11-21T01:17:10.866ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3232024-11-21T01:17:10.898ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3242024-11-21T01:17:10.898ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3252024-11-21T01:17:10.905ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3262024-11-21T01:17:10.905ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3272024-11-21T01:17:10.909ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3282024-11-21T01:17:10.909ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3292024-11-21T01:17:10.910ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-11-21T01:17:10.910ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-11-21T01:17:10.912ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3322024-11-21T01:17:10.914ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3332024-11-21T01:17:10.927ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3342024-11-21T01:17:10.927ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3352024-11-21T01:17:10.974ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3362024-11-21T01:17:10.975ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3372024-11-21T01:17:10.990ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3382024-11-21T01:17:10.990ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3392024-11-21T01:17:10.992ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3402024-11-21T01:17:10.992ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3412024-11-21T01:17:10.994ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3422024-11-21T01:17:10.994ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3432024-11-21T01:17:10.995ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3442024-11-21T01:17:10.999ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3452024-11-21T01:17:10.999ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3462024-11-21T01:17:10.999ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3472024-11-21T01:17:11.004ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3482024-11-21T01:17:11.004ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3492024-11-21T01:17:11.005ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3502024-11-21T01:17:11.005ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3512024-11-21T01:17:11.007ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3522024-11-21T01:17:11.007ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3532024-11-21T01:17:11.008ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542024-11-21T01:17:11.009ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552024-11-21T01:17:11.010ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3562024-11-21T01:17:11.013ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3572024-11-21T01:17:11.019ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582024-11-21T01:17:11.019ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3592024-11-21T01:17:11.091ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3602024-11-21T01:17:11.091ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3612024-11-21T01:17:11.114ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622024-11-21T01:17:11.115ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3632024-11-21T01:17:11.117ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3642024-11-21T01:17:11.117ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3652024-11-21T01:17:11.129ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662024-11-21T01:17:11.129ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672024-11-21T01:17:11.134ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3682024-11-21T01:17:11.138ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3692024-11-21T01:17:11.138ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3702024-11-21T01:17:11.138ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3712024-11-21T01:17:11.153ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3722024-11-21T01:17:11.153ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3732024-11-21T01:17:11.153ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3742024-11-21T01:17:11.154ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3752024-11-21T01:17:11.154ZDEBGnexus (DataLoader): attempting to create silo users
3762024-11-21T01:17:11.154ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3772024-11-21T01:17:11.154ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3782024-11-21T01:17:11.163ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3792024-11-21T01:17:11.163ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3802024-11-21T01:17:11.163ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3812024-11-21T01:17:11.163ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3822024-11-21T01:17:11.167ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3832024-11-21T01:17:11.167ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3842024-11-21T01:17:11.167ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3852024-11-21T01:17:11.179ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3862024-11-21T01:17:11.179ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3872024-11-21T01:17:11.188ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3882024-11-21T01:17:11.188ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3892024-11-21T01:17:11.190ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3902024-11-21T01:17:11.191ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3912024-11-21T01:17:11.191ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3922024-11-21T01:17:11.191ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3932024-11-21T01:17:11.200ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3942024-11-21T01:17:11.200ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3952024-11-21T01:17:11.201ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3962024-11-21T01:17:11.202ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3972024-11-21T01:17:11.202ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3982024-11-21T01:17:11.203ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3992024-11-21T01:17:11.289ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4002024-11-21T01:17:11.289ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4012024-11-21T01:17:11.290ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:33501
4022024-11-21T01:17:11.293ZINFOnexus: populate complete file = nexus/src/app/mod.rs:555
4032024-11-21T01:17:11.293ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:564
4042024-11-21T01:17:11.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33501 req_id = 30ccc247-39f8-464e-98ae-4654a9f53324 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
4052024-11-21T01:17:11.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33501 req_id = 30ccc247-39f8-464e-98ae-4654a9f53324 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
4062024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4072024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4082024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4092024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4102024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4112024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4122024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4132024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4142024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4152024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4162024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4172024-11-21T01:17:11.301ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4182024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4192024-11-21T01:17:11.301ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4202024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4212024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4222024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4232024-11-21T01:17:11.301ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4242024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4252024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4262024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4272024-11-21T01:17:11.301ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4282024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4292024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4302024-11-21T01:17:11.301ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4312024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4322024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4332024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4342024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4352024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4362024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4372024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4382024-11-21T01:17:11.301ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:07:11.301481633 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4392024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4402024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4412024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4422024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4432024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4442024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4452024-11-21T01:17:11.301ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4462024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4472024-11-21T01:17:11.301ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4482024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4492024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4502024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4512024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4522024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4532024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4542024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4552024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4562024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4572024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4582024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4592024-11-21T01:17:11.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4602024-11-21T01:17:11.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4612024-11-21T01:17:11.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4622024-11-21T01:17:11.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4632024-11-21T01:17:11.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4642024-11-21T01:17:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.40577ms iteration = 1 status = {"error":"no config nor servers"}
4652024-11-21T01:17:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.527661ms iteration = 1 status = {"error":"no blueprint"}
4662024-11-21T01:17:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.546762ms iteration = 1 status = {"error":"no blueprint"}
4672024-11-21T01:17:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.349559ms iteration = 1 status = {"error":"no config nor servers"}
4682024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4692024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4702024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4712024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4722024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4732024-11-21T01:17:11.303ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4742024-11-21T01:17:11.303ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4752024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4762024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4772024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4782024-11-21T01:17:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4792024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4802024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4812024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4822024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4832024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4842024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4852024-11-21T01:17:11.304ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4862024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4872024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4882024-11-21T01:17:11.304ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1010, tv_nsec: 204689249 } })
4892024-11-21T01:17:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4902024-11-21T01:17:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4912024-11-21T01:17:11.305ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1010, tv_nsec: 204901692 } })
4922024-11-21T01:17:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4932024-11-21T01:17:11.305ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4942024-11-21T01:17:11.305ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4952024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.509617ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
4962024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.474597ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
4972024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4982024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4992024-11-21T01:17:11.306ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5002024-11-21T01:17:11.306ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5012024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 4.73\u{b5}s iteration = 2 status = {"error":"no config"}
5022024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 4.87\u{b5}s iteration = 2 status = {"error":"no config"}
5032024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5042024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5052024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5062024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5072024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5082024-11-21T01:17:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5092024-11-21T01:17:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5102024-11-21T01:17:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5112024-11-21T01:17:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5122024-11-21T01:17:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5132024-11-21T01:17:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5142024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5152024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5162024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5172024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5182024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5192024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5202024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5212024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5222024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5232024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5242024-11-21T01:17:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5252024-11-21T01:17:11.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33501 req_id = 30ccc247-39f8-464e-98ae-4654a9f53324 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
5262024-11-21T01:17:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5272024-11-21T01:17:11.309ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5282024-11-21T01:17:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5292024-11-21T01:17:11.312ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1010, tv_nsec: 212094074 } })
5302024-11-21T01:17:11.312ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
5312024-11-21T01:17:11.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5322024-11-21T01:17:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5332024-11-21T01:17:11.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5342024-11-21T01:17:11.318ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.671711ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5352024-11-21T01:17:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5362024-11-21T01:17:11.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5372024-11-21T01:17:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5382024-11-21T01:17:11.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33501 req_id = 6de1e74a-b5ac-4d52-939e-03fbb01cec0e roles = RoleSet { roles: {} } uri = /sled-agents/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
5392024-11-21T01:17:11.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33501 req_id = 6de1e74a-b5ac-4d52-939e-03fbb01cec0e resource = Database result = Ok(()) uri = /sled-agents/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
5402024-11-21T01:17:11.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5412024-11-21T01:17:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5422024-11-21T01:17:11.330ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:07:11.301481633 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5432024-11-21T01:17:11.330ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 29.481185ms iteration = 1 status = {"expiration":"2024-11-21T01:07:11.301481633Z","pruned":[]}
5442024-11-21T01:17:11.348ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 47.665732ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5452024-11-21T01:17:11.349ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5462024-11-21T01:17:11.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1010, tv_nsec: 251355867 } })
5472024-11-21T01:17:11.351ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
5482024-11-21T01:17:11.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5492024-11-21T01:17:11.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5502024-11-21T01:17:11.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5512024-11-21T01:17:11.355ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
5522024-11-21T01:17:11.355ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5532024-11-21T01:17:11.356ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d90784f-4394-4494-ae81-2f9d8afa63ce", "content-length": "26", "date": "Thu, 21 Nov 2024 01:17:10 GMT"} })
5542024-11-21T01:17:11.356ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552024-11-21T01:17:11.357ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5562024-11-21T01:17:11.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.842262ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5572024-11-21T01:17:11.358ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5582024-11-21T01:17:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5592024-11-21T01:17:11.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-11-21T01:17:11.361ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5612024-11-21T01:17:11.361ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5622024-11-21T01:17:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5632024-11-21T01:17:11.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5642024-11-21T01:17:11.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652024-11-21T01:17:11.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5662024-11-21T01:17:11.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5672024-11-21T01:17:11.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5682024-11-21T01:17:11.365ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5692024-11-21T01:17:11.365ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(52c41240-4d39-450a-92cd-3ffba820de7f, 0)]
5702024-11-21T01:17:11.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5712024-11-21T01:17:11.366ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1010, tv_nsec: 265877482 } })
5722024-11-21T01:17:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5732024-11-21T01:17:11.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5742024-11-21T01:17:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5752024-11-21T01:17:11.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5762024-11-21T01:17:11.368ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5772024-11-21T01:17:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5782024-11-21T01:17:11.369ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 68.230771ms iteration = 1 status = {}
5792024-11-21T01:17:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5802024-11-21T01:17:11.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5812024-11-21T01:17:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5822024-11-21T01:17:11.370ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5832024-11-21T01:17:11.370ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5842024-11-21T01:17:11.370ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5852024-11-21T01:17:11.370ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862024-11-21T01:17:11.370ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "623db7ea-cdeb-43ac-a5e8-f5c9bffff048" error_message_internal = not found: sled with id "623db7ea-cdeb-43ac-a5e8-f5c9bffff048" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 50750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33501 req_id = 6de1e74a-b5ac-4d52-939e-03fbb01cec0e response_code = 404 uri = /sled-agents/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
5872024-11-21T01:17:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5882024-11-21T01:17:11.370ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
5892024-11-21T01:17:11.370ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 70.016267ms iteration = 1 status = {"error":"rack not yet initialized: e0f91ea1-f368-4705-9818-7568a8475d7c"}
5902024-11-21T01:17:11.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5912024-11-21T01:17:11.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5922024-11-21T01:17:11.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5932024-11-21T01:17:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5942024-11-21T01:17:11.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5952024-11-21T01:17:11.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5962024-11-21T01:17:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5972024-11-21T01:17:11.374ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5982024-11-21T01:17:11.374ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 71.284395ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5992024-11-21T01:17:11.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002024-11-21T01:17:11.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6012024-11-21T01:17:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6022024-11-21T01:17:11.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6032024-11-21T01:17:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6042024-11-21T01:17:11.378ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6052024-11-21T01:17:11.378ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6062024-11-21T01:17:11.378ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6072024-11-21T01:17:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6082024-11-21T01:17:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6092024-11-21T01:17:11.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6102024-11-21T01:17:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6112024-11-21T01:17:11.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6122024-11-21T01:17:11.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6132024-11-21T01:17:11.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6142024-11-21T01:17:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6152024-11-21T01:17:11.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6162024-11-21T01:17:11.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6172024-11-21T01:17:11.386ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6182024-11-21T01:17:11.386ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6192024-11-21T01:17:11.386ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.519587ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6202024-11-21T01:17:11.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6212024-11-21T01:17:11.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222024-11-21T01:17:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6232024-11-21T01:17:11.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6242024-11-21T01:17:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6252024-11-21T01:17:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6262024-11-21T01:17:11.395ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6272024-11-21T01:17:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6282024-11-21T01:17:11.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.441158ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6292024-11-21T01:17:11.412ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6302024-11-21T01:17:11.412ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 110.465246ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6312024-11-21T01:17:11.412ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6322024-11-21T01:17:11.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6332024-11-21T01:17:11.414ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6342024-11-21T01:17:11.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 111.077626ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
6352024-11-21T01:17:11.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.426548ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6362024-11-21T01:17:11.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6372024-11-21T01:17:11.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6382024-11-21T01:17:11.417ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6392024-11-21T01:17:11.417ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 116.539562ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6402024-11-21T01:17:11.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6412024-11-21T01:17:11.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6422024-11-21T01:17:11.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 124.744438ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6432024-11-21T01:17:11.432ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6442024-11-21T01:17:11.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6452024-11-21T01:17:11.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462024-11-21T01:17:11.438ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6472024-11-21T01:17:11.438ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 138.272418ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6482024-11-21T01:17:11.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6492024-11-21T01:17:11.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6502024-11-21T01:17:11.440ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45145
6512024-11-21T01:17:11.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6522024-11-21T01:17:11.442ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6532024-11-21T01:17:11.442ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6542024-11-21T01:17:11.442ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.778504ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6552024-11-21T01:17:11.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6562024-11-21T01:17:11.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6572024-11-21T01:17:11.443ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6582024-11-21T01:17:11.443ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6592024-11-21T01:17:11.443ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0a06b35-9b53-4367-9ced-7dcd45520fb9", "content-length": "26", "date": "Thu, 21 Nov 2024 01:17:10 GMT"} })
6602024-11-21T01:17:11.443ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6612024-11-21T01:17:11.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6622024-11-21T01:17:11.444ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6632024-11-21T01:17:11.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 143.699065ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6642024-11-21T01:17:11.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6652024-11-21T01:17:11.444ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6662024-11-21T01:17:11.445ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 144.70254ms iteration = 1 status = {}
6672024-11-21T01:17:11.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-11-21T01:17:11.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6692024-11-21T01:17:11.449ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6702024-11-21T01:17:11.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6712024-11-21T01:17:11.452ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6722024-11-21T01:17:11.452ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6732024-11-21T01:17:11.452ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 151.760198ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6742024-11-21T01:17:11.455ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6752024-11-21T01:17:11.455ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6762024-11-21T01:17:11.455ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6772024-11-21T01:17:11.456ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e8ee5f8-7c1b-4696-b983-95334dd7f64a", "content-length": "476", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
6782024-11-21T01:17:11.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.68681ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6792024-11-21T01:17:11.458ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6802024-11-21T01:17:11.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6812024-11-21T01:17:11.458ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7332fd83-9139-4bf4-9592-49a588f46e3e", "content-length": "734", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
6822024-11-21T01:17:11.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6832024-11-21T01:17:11.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6842024-11-21T01:17:11.460ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6852024-11-21T01:17:11.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6862024-11-21T01:17:11.461ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "97633188-bfad-4cc9-bfa5-d99fe9469d24", "content-length": "111", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
6872024-11-21T01:17:11.461ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6882024-11-21T01:17:11.461ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "269c17d6-cd3b-4f77-b0b8-766e7dd098b3", "content-length": "111", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
6892024-11-21T01:17:11.462ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6902024-11-21T01:17:11.462ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab79c7af-f02f-49fc-8369-c7ce5c26b1bb", "content-length": "167", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
6912024-11-21T01:17:11.462ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6922024-11-21T01:17:11.462ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6932024-11-21T01:17:11.462ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "65d721e6-956d-4809-a4e7-ea30e0562e86", "content-length": "167", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
6942024-11-21T01:17:11.462ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6952024-11-21T01:17:11.463ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6beb10db-0074-4925-b0b0-e1a045cf0057", "content-length": "175", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
6962024-11-21T01:17:11.463ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6972024-11-21T01:17:11.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6982024-11-21T01:17:11.463ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f125ea8-dbc4-4fd2-bf61-457f44b21d4f", "content-length": "175", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
6992024-11-21T01:17:11.463ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
7002024-11-21T01:17:11.463ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "388c65ed-e561-4c0d-9ff2-58538aaaa3b2", "content-length": "702", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7012024-11-21T01:17:11.464ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7022024-11-21T01:17:11.464ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e827fdd-c7a1-49aa-ab2d-55a0f1ffe567", "content-length": "727", "date": "Thu, 21 Nov 2024 01:17:10 GMT"} })
7032024-11-21T01:17:11.464ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7042024-11-21T01:17:11.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7052024-11-21T01:17:11.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7062024-11-21T01:17:11.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7072024-11-21T01:17:11.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7082024-11-21T01:17:11.467ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
7092024-11-21T01:17:11.467ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 166.880171ms iteration = 1 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
7102024-11-21T01:17:11.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7112024-11-21T01:17:11.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7122024-11-21T01:17:11.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.661653ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7132024-11-21T01:17:11.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7142024-11-21T01:17:11.469ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 168.059108ms iteration = 1 status = {}
7152024-11-21T01:17:11.470ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c640a73f-89ad-4a88-929c-3932012a2572", "content-length": "729", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7162024-11-21T01:17:11.470ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7172024-11-21T01:17:11.470ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aa1fc59-4089-4945-b2aa-9a521782cb8d", "content-length": "728", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7182024-11-21T01:17:11.470ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7192024-11-21T01:17:11.470ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9931f7d-180b-43d0-ab7e-4ccfe0dc0410", "content-length": "722", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7202024-11-21T01:17:11.471ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7212024-11-21T01:17:11.471ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dc0e422-7afc-4eba-a39b-53d4a9fb3031", "content-length": "109", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7222024-11-21T01:17:11.471ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7232024-11-21T01:17:11.471ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dd3aab8-ce2d-4a17-a704-a675e8918505", "content-length": "109", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7242024-11-21T01:17:11.471ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7252024-11-21T01:17:11.471ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3abf4ac-520a-4547-b4a0-d2eb596002b4", "content-length": "169", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7262024-11-21T01:17:11.471ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7272024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "38c18d51-e785-4c47-9918-13dbbe7510bb", "content-length": "169", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7282024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7292024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6c65a33-5041-4b4f-ab6a-96fc59795efd", "content-length": "178", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7302024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7312024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "178be681-fef8-4f31-bb51-d25bf6aa66c4", "content-length": "178", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7322024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7332024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "871e7b47-7da2-4ae7-bddb-d7eaeac79ece", "content-length": "702", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7342024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7352024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bec090cd-95d0-435b-9972-0a164495e479", "content-length": "727", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7362024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7372024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7382024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7392024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b506629b-886f-4b2b-9493-075ccfca0a41", "content-length": "729", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7402024-11-21T01:17:11.472ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7412024-11-21T01:17:11.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7422024-11-21T01:17:11.473ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7ee8556-04fe-40d0-8ec7-39fca2b61ef8", "content-length": "728", "date": "Thu, 21 Nov 2024 01:17:11 GMT"} })
7432024-11-21T01:17:11.473ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7442024-11-21T01:17:11.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7452024-11-21T01:17:11.474ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7462024-11-21T01:17:11.474ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7472024-11-21T01:17:11.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7482024-11-21T01:17:11.475ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7492024-11-21T01:17:11.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7502024-11-21T01:17:11.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7512024-11-21T01:17:11.477ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7522024-11-21T01:17:11.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7532024-11-21T01:17:11.477ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7542024-11-21T01:17:11.478ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "087aec42-56bb-4d90-a225-1caa38f6aaa6", "content-length": "1", "date": "Thu, 21 Nov 2024 01:17:10 GMT"} })
7552024-11-21T01:17:11.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7562024-11-21T01:17:11.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7572024-11-21T01:17:11.479ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7582024-11-21T01:17:11.479ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7592024-11-21T01:17:11.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7602024-11-21T01:17:11.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7612024-11-21T01:17:11.480ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7622024-11-21T01:17:11.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7632024-11-21T01:17:11.481ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-11-21T01:17:11.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652024-11-21T01:17:11.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7662024-11-21T01:17:11.482ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7672024-11-21T01:17:11.482ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7682024-11-21T01:17:11.482ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7692024-11-21T01:17:11.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7702024-11-21T01:17:11.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7712024-11-21T01:17:11.484ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7722024-11-21T01:17:11.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732024-11-21T01:17:11.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7742024-11-21T01:17:11.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7752024-11-21T01:17:11.486ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7762024-11-21T01:17:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7772024-11-21T01:17:11.488ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7782024-11-21T01:17:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7792024-11-21T01:17:11.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7802024-11-21T01:17:11.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7812024-11-21T01:17:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7822024-11-21T01:17:11.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7832024-11-21T01:17:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7842024-11-21T01:17:11.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7852024-11-21T01:17:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7862024-11-21T01:17:11.494ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7872024-11-21T01:17:11.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7882024-11-21T01:17:11.497ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7892024-11-21T01:17:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7902024-11-21T01:17:11.500ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 199.534562ms iteration = 1 status = null
7912024-11-21T01:17:11.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7922024-11-21T01:17:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7932024-11-21T01:17:11.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7942024-11-21T01:17:11.504ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7952024-11-21T01:17:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7962024-11-21T01:17:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7972024-11-21T01:17:11.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7982024-11-21T01:17:11.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7992024-11-21T01:17:11.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8002024-11-21T01:17:11.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8012024-11-21T01:17:11.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8022024-11-21T01:17:11.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8032024-11-21T01:17:11.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8042024-11-21T01:17:11.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8052024-11-21T01:17:11.550ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8062024-11-21T01:17:11.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8072024-11-21T01:17:11.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8082024-11-21T01:17:11.555ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
8092024-11-21T01:17:11.555ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 254.255713ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
8102024-11-21T01:17:11.556ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8112024-11-21T01:17:11.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8122024-11-21T01:17:11.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8132024-11-21T01:17:11.558ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8142024-11-21T01:17:11.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8152024-11-21T01:17:11.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8162024-11-21T01:17:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8172024-11-21T01:17:11.561ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8182024-11-21T01:17:11.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8192024-11-21T01:17:11.565ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8202024-11-21T01:17:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8212024-11-21T01:17:11.571ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
8222024-11-21T01:17:11.572ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8232024-11-21T01:17:11.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8242024-11-21T01:17:11.574ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8252024-11-21T01:17:11.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8262024-11-21T01:17:11.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8272024-11-21T01:17:11.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8282024-11-21T01:17:11.590ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8292024-11-21T01:17:11.590ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8302024-11-21T01:17:11.590ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8312024-11-21T01:17:11.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8322024-11-21T01:17:11.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8332024-11-21T01:17:11.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8342024-11-21T01:17:11.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8352024-11-21T01:17:11.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8362024-11-21T01:17:11.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8372024-11-21T01:17:11.620ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8382024-11-21T01:17:11.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8392024-11-21T01:17:11.621ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8402024-11-21T01:17:11.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8412024-11-21T01:17:11.671ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 475cf7bc-78b5-49fa-afcf-1b1ea0d08443 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
8422024-11-21T01:17:11.671ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 475cf7bc-78b5-49fa-afcf-1b1ea0d08443 time_started = 2024-11-21 01:17:11.450749 UTC
8432024-11-21T01:17:11.672ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 371.259712ms iteration = 1 status = {"collection_id":"475cf7bc-78b5-49fa-afcf-1b1ea0d08443","time_done":"2024-11-21 01:17:11.482784 UTC","time_started":"2024-11-21 01:17:11.450749 UTC"}
8442024-11-21T01:17:11.672ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8452024-11-21T01:17:11.672ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8462024-11-21T01:17:11.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8472024-11-21T01:17:11.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8482024-11-21T01:17:11.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8492024-11-21T01:17:11.675ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8502024-11-21T01:17:11.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8512024-11-21T01:17:11.677ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
8522024-11-21T01:17:11.677ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.287004ms iteration = 2 status = {"error":"rack not yet initialized: e0f91ea1-f368-4705-9818-7568a8475d7c"}
8532024-11-21T01:17:11.680ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 379.875013ms iteration = 1 status = {}
8542024-11-21T01:17:11.700ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8552024-11-21T01:17:11.700ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8562024-11-21T01:17:11.700ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8572024-11-21T01:17:11.701ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 399.294117ms
8582024-11-21T01:17:11.701ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 399.322177ms iteration = 1 status = {}
8592024-11-21T01:17:12.154ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8602024-11-21T01:17:12.154ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8612024-11-21T01:17:12.156ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8622024-11-21T01:17:12.156ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8632024-11-21T01:17:12.157ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8642024-11-21T01:17:12.160ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e0f91ea1-f368-4705-9818-7568a8475d7c, lookup_type: ById(e0f91ea1-f368-4705-9818-7568a8475d7c) } result = Ok(())
8652024-11-21T01:17:12.160ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: e0f91ea1-f368-4705-9818-7568a8475d7c, time_created: 2024-11-21T01:17:11.179393Z, time_modified: 2024-11-21T01:17:11.179393Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
8662024-11-21T01:17:12.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6082d8c8-8d2c-4e8b-9fe4-9081ce85a763 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
8672024-11-21T01:17:12.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6082d8c8-8d2c-4e8b-9fe4-9081ce85a763 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
8682024-11-21T01:17:12.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6082d8c8-8d2c-4e8b-9fe4-9081ce85a763 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
8692024-11-21T01:17:13.128ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:55 sled_uuid = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048
8702024-11-21T01:17:13.232ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
8712024-11-21T01:17:13.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106046 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7f37df32-f390-4014-b914-ee09cf844a66 response_code = 204 uri = /sled-agents/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
8722024-11-21T01:17:13.232ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8732024-11-21T01:17:13.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8742024-11-21T01:17:13.234ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8752024-11-21T01:17:13.235ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8762024-11-21T01:17:13.235ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8772024-11-21T01:17:13.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8782024-11-21T01:17:13.239ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(52c41240-4d39-450a-92cd-3ffba820de7f, 0), (4f86296e-81d2-453b-8414-6b3c96f4a439, 0), (475cf7bc-78b5-49fa-afcf-1b1ea0d08443, 0)]
8792024-11-21T01:17:13.239ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1012, tv_nsec: 139661477 } })
8802024-11-21T01:17:13.274ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
8812024-11-21T01:17:13.274ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
8822024-11-21T01:17:13.274ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
8832024-11-21T01:17:13.276ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5aee647-93b5-4bff-8259-9634f08672d1", "content-length": "476", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
8842024-11-21T01:17:13.276ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
8852024-11-21T01:17:13.276ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f83dc87-76a6-4f90-80ed-36f32f36474e", "content-length": "734", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
8862024-11-21T01:17:13.276ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
8872024-11-21T01:17:13.276ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9870f27-f636-4650-b91d-6c38e7aa3a32", "content-length": "111", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
8882024-11-21T01:17:13.276ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
8892024-11-21T01:17:13.277ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "171115c8-07ef-43ef-b5ad-89eb4c444141", "content-length": "111", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
8902024-11-21T01:17:13.277ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
8912024-11-21T01:17:13.277ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5af1e67-d6fd-4a01-92f9-7baf05415294", "content-length": "167", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
8922024-11-21T01:17:13.277ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
8932024-11-21T01:17:13.277ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6747d4d2-ae74-43bf-b94f-dee9253842ad", "content-length": "167", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
8942024-11-21T01:17:13.277ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
8952024-11-21T01:17:13.278ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "28464de1-2b42-4e1c-9913-d2aedfaa491e", "content-length": "175", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
8962024-11-21T01:17:13.278ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
8972024-11-21T01:17:13.278ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bca200a-dd12-4de0-988d-20aa4e6edece", "content-length": "175", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
8982024-11-21T01:17:13.278ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
8992024-11-21T01:17:13.278ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "50d4f47e-c185-4008-bdfc-48f25ace4915", "content-length": "702", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9002024-11-21T01:17:13.278ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9012024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "79257ad5-48a8-47e0-9159-2fd764b936b5", "content-length": "727", "date": "Thu, 21 Nov 2024 01:17:12 GMT"} })
9022024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9032024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "afd6b4a7-574f-432c-8cca-d2d759225eba", "content-length": "729", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9042024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9052024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7db8ccc8-e820-4d79-bee8-51e33891c86e", "content-length": "728", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9062024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
9072024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "420df755-fa2e-41e7-984b-adadf7524cb2", "content-length": "722", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9082024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
9092024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "42e1ef85-d241-4f7d-b0e9-1f46076d37ec", "content-length": "109", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9102024-11-21T01:17:13.279ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
9112024-11-21T01:17:13.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "90960c50-aaa1-44a3-aa43-0db8c7d52e8e", "content-length": "109", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9122024-11-21T01:17:13.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
9132024-11-21T01:17:13.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "736a499f-c475-4df4-9ab7-8850be4cca35", "content-length": "169", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9142024-11-21T01:17:13.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
9152024-11-21T01:17:13.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9de439a8-374d-455e-8afb-6a625dafbd7c", "content-length": "169", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9162024-11-21T01:17:13.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
9172024-11-21T01:17:13.280ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7beaa182-1b20-47d4-87ae-295538456534", "content-length": "178", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9182024-11-21T01:17:13.280ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
9192024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aca70d3-6725-49a4-9b6d-9e8352259e68", "content-length": "178", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9202024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
9212024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ef62eb0-e672-4f78-a7dc-814080a93f82", "content-length": "702", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9222024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9232024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "17094574-5e10-40c8-bb5f-446d420faf20", "content-length": "727", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9242024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9252024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "42c794ec-9620-440f-ad42-6e270203e756", "content-length": "729", "date": "Thu, 21 Nov 2024 01:17:12 GMT"} })
9262024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9272024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "61e79da1-5316-404f-9d31-08129cb7bcec", "content-length": "728", "date": "Thu, 21 Nov 2024 01:17:12 GMT"} })
9282024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9292024-11-21T01:17:13.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9302024-11-21T01:17:13.283ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9312024-11-21T01:17:13.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9322024-11-21T01:17:13.285ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9332024-11-21T01:17:13.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9342024-11-21T01:17:13.287ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9352024-11-21T01:17:13.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9362024-11-21T01:17:13.288ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9372024-11-21T01:17:13.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9382024-11-21T01:17:13.323ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
9392024-11-21T01:17:13.323ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
9402024-11-21T01:17:13.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ea15c27f-031a-493b-932a-012a77846d11 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9412024-11-21T01:17:13.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ea15c27f-031a-493b-932a-012a77846d11 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9422024-11-21T01:17:13.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ea15c27f-031a-493b-932a-012a77846d11 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9432024-11-21T01:17:13.524ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "49e07710-57d3-41ce-8fe9-b1532339c272", "content-length": "30742", "date": "Thu, 21 Nov 2024 01:17:13 GMT"} })
9442024-11-21T01:17:13.526ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9452024-11-21T01:17:13.526ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9462024-11-21T01:17:13.526ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9472024-11-21T01:17:13.528ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9482024-11-21T01:17:13.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9492024-11-21T01:17:13.530ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9502024-11-21T01:17:13.532ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9512024-11-21T01:17:13.532ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9522024-11-21T01:17:13.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9532024-11-21T01:17:13.724ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = ed4e3252-0a22-4eb1-879f-b3666090902e file = nexus/db-queries/src/db/datastore/inventory.rs:1000
9542024-11-21T01:17:13.724ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = ed4e3252-0a22-4eb1-879f-b3666090902e time_started = 2024-11-21 01:17:13.274515 UTC
9552024-11-21T01:17:13.724ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 492.429929ms iteration = 2 status = {"collection_id":"ed4e3252-0a22-4eb1-879f-b3666090902e","time_done":"2024-11-21 01:17:13.526982 UTC","time_started":"2024-11-21 01:17:13.274515 UTC"}
9562024-11-21T01:17:13.724ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
9572024-11-21T01:17:13.724ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9582024-11-21T01:17:13.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9592024-11-21T01:17:13.726ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9602024-11-21T01:17:13.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9612024-11-21T01:17:13.728ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9622024-11-21T01:17:13.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9632024-11-21T01:17:13.730ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
9642024-11-21T01:17:13.730ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.843543ms iteration = 3 status = {"error":"rack not yet initialized: e0f91ea1-f368-4705-9818-7568a8475d7c"}
9652024-11-21T01:17:14.161ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9662024-11-21T01:17:14.161ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9672024-11-21T01:17:14.163ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9682024-11-21T01:17:14.163ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9692024-11-21T01:17:14.165ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9702024-11-21T01:17:14.167ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e0f91ea1-f368-4705-9818-7568a8475d7c, lookup_type: ById(e0f91ea1-f368-4705-9818-7568a8475d7c) } result = Ok(())
9712024-11-21T01:17:14.167ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: e0f91ea1-f368-4705-9818-7568a8475d7c, time_created: 2024-11-21T01:17:11.179393Z, time_modified: 2024-11-21T01:17:11.179393Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9722024-11-21T01:17:14.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12f87dec-1222-4208-a4e2-e668f7bbcb98 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9732024-11-21T01:17:14.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12f87dec-1222-4208-a4e2-e668f7bbcb98 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9742024-11-21T01:17:14.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12f87dec-1222-4208-a4e2-e668f7bbcb98 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9752024-11-21T01:17:15.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31159e86-d432-4839-b2b3-27eba8bc3a45 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9762024-11-21T01:17:15.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31159e86-d432-4839-b2b3-27eba8bc3a45 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9772024-11-21T01:17:15.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31159e86-d432-4839-b2b3-27eba8bc3a45 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
9782024-11-21T01:17:16.169ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9792024-11-21T01:17:16.169ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9802024-11-21T01:17:16.171ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9812024-11-21T01:17:16.171ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9822024-11-21T01:17:16.173ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9832024-11-21T01:17:16.175ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: e0f91ea1-f368-4705-9818-7568a8475d7c, lookup_type: ById(e0f91ea1-f368-4705-9818-7568a8475d7c) } result = Ok(())
9842024-11-21T01:17:16.175ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
9852024-11-21T01:17:16.175ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9862024-11-21T01:17:16.175ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9872024-11-21T01:17:16.177ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9882024-11-21T01:17:16.177ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9892024-11-21T01:17:16.179ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9902024-11-21T01:17:16.179ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9912024-11-21T01:17:16.181ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9922024-11-21T01:17:16.181ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9932024-11-21T01:17:16.182ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9942024-11-21T01:17:16.182ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9952024-11-21T01:17:16.183ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
9962024-11-21T01:17:16.183ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
9972024-11-21T01:17:16.185ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9982024-11-21T01:17:16.187ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9992024-11-21T01:17:16.188ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10002024-11-21T01:17:16.188ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10012024-11-21T01:17:16.189ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10022024-11-21T01:17:16.189ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10032024-11-21T01:17:16.191ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10042024-11-21T01:17:16.191ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10052024-11-21T01:17:16.192ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10062024-11-21T01:17:16.195ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10072024-11-21T01:17:16.195ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10082024-11-21T01:17:16.195ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10092024-11-21T01:17:16.197ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10102024-11-21T01:17:16.197ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10112024-11-21T01:17:16.199ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10122024-11-21T01:17:16.199ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10132024-11-21T01:17:16.200ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10142024-11-21T01:17:16.200ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10152024-11-21T01:17:16.201ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10162024-11-21T01:17:16.202ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10172024-11-21T01:17:16.203ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10182024-11-21T01:17:16.203ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10192024-11-21T01:17:16.204ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10202024-11-21T01:17:16.204ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10212024-11-21T01:17:16.205ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10222024-11-21T01:17:16.208ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10232024-11-21T01:17:16.208ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10242024-11-21T01:17:16.208ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10252024-11-21T01:17:16.210ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10262024-11-21T01:17:16.210ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10272024-11-21T01:17:16.211ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10282024-11-21T01:17:16.211ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10292024-11-21T01:17:16.213ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10302024-11-21T01:17:16.213ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10312024-11-21T01:17:16.215ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10322024-11-21T01:17:16.215ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10332024-11-21T01:17:16.216ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10342024-11-21T01:17:16.216ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10352024-11-21T01:17:16.218ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10362024-11-21T01:17:16.218ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10372024-11-21T01:17:16.219ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10382024-11-21T01:17:16.222ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10392024-11-21T01:17:16.222ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10402024-11-21T01:17:16.222ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10412024-11-21T01:17:16.224ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10422024-11-21T01:17:16.224ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10432024-11-21T01:17:16.225ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10442024-11-21T01:17:16.225ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10452024-11-21T01:17:16.226ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10462024-11-21T01:17:16.229ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10472024-11-21T01:17:16.229ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10482024-11-21T01:17:16.229ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10492024-11-21T01:17:16.233ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10502024-11-21T01:17:16.233ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10512024-11-21T01:17:16.234ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10522024-11-21T01:17:16.235ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10532024-11-21T01:17:16.236ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10542024-11-21T01:17:16.236ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10552024-11-21T01:17:16.237ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10562024-11-21T01:17:16.237ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10572024-11-21T01:17:16.239ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10582024-11-21T01:17:16.239ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10592024-11-21T01:17:16.240ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10602024-11-21T01:17:16.241ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10612024-11-21T01:17:16.242ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10622024-11-21T01:17:16.242ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10632024-11-21T01:17:16.243ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10642024-11-21T01:17:16.246ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10652024-11-21T01:17:16.246ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10662024-11-21T01:17:16.246ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10672024-11-21T01:17:16.247ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10682024-11-21T01:17:16.248ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10692024-11-21T01:17:16.249ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10702024-11-21T01:17:16.249ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10712024-11-21T01:17:16.250ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10722024-11-21T01:17:16.253ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10732024-11-21T01:17:16.253ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10742024-11-21T01:17:16.253ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10752024-11-21T01:17:16.259ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 4d6538e9-2779-4ffe-b732-b8ef5b68fff3, kind: Service { id: 50ef7a5a-8210-43f1-a548-846251e25074 }, name: Name("external-dns-50ef7a5a-8210-43f1-a548-846251e25074"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 90d25e95-e0a0-4767-914f-6a42c8b1e264, kind: Service { id: 403cce04-ffba-4276-94a6-76cab9338e71 }, name: Name("external-dns-403cce04-ffba-4276-94a6-76cab9338e71"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 63031233-d4cf-486c-a883-b94591ef6215, kind: Service { id: bbffc4db-58c5-4210-973d-49d52a55513e }, name: Name("nexus-bbffc4db-58c5-4210-973d-49d52a55513e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6eb7eb-9f19-4410-8b07-657b90ce790a, kind: Service { id: 5382fba6-edea-49d2-8ecc-9b1edfc688be }, name: Name("nexus-5382fba6-edea-49d2-8ecc-9b1edfc688be"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 138])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e349c246-31d7-4a6d-8e38-cf8679bf8d63, kind: Service { id: 3285ddd9-4901-4d45-8459-dd50ba0635ef }, name: Name("nexus-3285ddd9-4901-4d45-8459-dd50ba0635ef"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
10762024-11-21T01:17:16.259ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10772024-11-21T01:17:16.259ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10782024-11-21T01:17:16.260ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10792024-11-21T01:17:16.261ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
10802024-11-21T01:17:16.261ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10812024-11-21T01:17:16.261ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10822024-11-21T01:17:16.263ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
10832024-11-21T01:17:16.265ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4d6538e9-2779-4ffe-b732-b8ef5b68fff3, kind: Service { id: 50ef7a5a-8210-43f1-a548-846251e25074 }, name: Name("external-dns-50ef7a5a-8210-43f1-a548-846251e25074"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 90d25e95-e0a0-4767-914f-6a42c8b1e264, kind: Service { id: 403cce04-ffba-4276-94a6-76cab9338e71 }, name: Name("external-dns-403cce04-ffba-4276-94a6-76cab9338e71"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 63031233-d4cf-486c-a883-b94591ef6215, kind: Service { id: bbffc4db-58c5-4210-973d-49d52a55513e }, name: Name("nexus-bbffc4db-58c5-4210-973d-49d52a55513e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6eb7eb-9f19-4410-8b07-657b90ce790a, kind: Service { id: 5382fba6-edea-49d2-8ecc-9b1edfc688be }, name: Name("nexus-5382fba6-edea-49d2-8ecc-9b1edfc688be"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 138])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e349c246-31d7-4a6d-8e38-cf8679bf8d63, kind: Service { id: 3285ddd9-4901-4d45-8459-dd50ba0635ef }, name: Name("nexus-3285ddd9-4901-4d45-8459-dd50ba0635ef"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
10842024-11-21T01:17:16.265ZDEBGnexus (InternalApi): resolved 2 rules for sleds
10852024-11-21T01:17:16.376ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, time_created: 2024-11-21T01:17:13.128462Z, time_modified: 2024-11-21T01:17:13.128462Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
10862024-11-21T01:17:16.376ZDEBGnexus (InternalApi): sending firewall rules to sled agents
10872024-11-21T01:17:16.376ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10882024-11-21T01:17:16.376ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10892024-11-21T01:17:16.378ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
10902024-11-21T01:17:16.378ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
10912024-11-21T01:17:16.380ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922024-11-21T01:17:16.382ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
10932024-11-21T01:17:16.414ZDEBGnexus (InternalApi): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
10942024-11-21T01:17:16.415ZDEBGnexus (InternalApi): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "fee2a1c1-94fd-4678-834b-81ce828b05c9", "date": "Thu, 21 Nov 2024 01:17:15 GMT"} })
10952024-11-21T01:17:16.415ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
10962024-11-21T01:17:16.415ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
10972024-11-21T01:17:16.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = becd613f-0133-4ddf-a1e2-612b278e362d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
10982024-11-21T01:17:16.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = becd613f-0133-4ddf-a1e2-612b278e362d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
10992024-11-21T01:17:16.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = becd613f-0133-4ddf-a1e2-612b278e362d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11002024-11-21T01:17:17.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 328c087d-13f5-4da2-9e37-d860c7966cb1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11012024-11-21T01:17:17.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 328c087d-13f5-4da2-9e37-d860c7966cb1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11022024-11-21T01:17:17.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 328c087d-13f5-4da2-9e37-d860c7966cb1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11032024-11-21T01:17:18.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d2500336-f46a-4457-a7ba-09da6b2c115c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11042024-11-21T01:17:18.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d2500336-f46a-4457-a7ba-09da6b2c115c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11052024-11-21T01:17:18.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d2500336-f46a-4457-a7ba-09da6b2c115c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11062024-11-21T01:17:19.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac0d5dfa-6a63-4612-9336-216b0f4ffbd6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11072024-11-21T01:17:19.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac0d5dfa-6a63-4612-9336-216b0f4ffbd6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11082024-11-21T01:17:19.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac0d5dfa-6a63-4612-9336-216b0f4ffbd6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11092024-11-21T01:17:20.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 737b1317-9522-4eaf-aacd-2711996d9676 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11102024-11-21T01:17:20.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 737b1317-9522-4eaf-aacd-2711996d9676 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11112024-11-21T01:17:20.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 737b1317-9522-4eaf-aacd-2711996d9676 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
11122024-11-21T01:17:21.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
11132024-11-21T01:17:21.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11142024-11-21T01:17:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11152024-11-21T01:17:21.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
11162024-11-21T01:17:21.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11172024-11-21T01:17:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11182024-11-21T01:17:21.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11192024-11-21T01:17:21.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11202024-11-21T01:17:21.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11212024-11-21T01:17:21.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11222024-11-21T01:17:21.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11232024-11-21T01:17:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11242024-11-21T01:17:21.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11252024-11-21T01:17:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
11262024-11-21T01:17:21.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11272024-11-21T01:17:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11282024-11-21T01:17:21.329ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
11292024-11-21T01:17:21.329ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
11302024-11-21T01:17:21.329ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
11312024-11-21T01:17:21.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.605573ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z","time_found":"2024-11-21T01:17:21.329789551Z"}
11322024-11-21T01:17:21.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.7\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
11332024-11-21T01:17:21.329ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
11342024-11-21T01:17:21.329ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11352024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11362024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11372024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11382024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11392024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11402024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11412024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11422024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11432024-11-21T01:17:21.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11442024-11-21T01:17:21.332ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11452024-11-21T01:17:21.332ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11462024-11-21T01:17:21.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11472024-11-21T01:17:21.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11482024-11-21T01:17:21.334ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11492024-11-21T01:17:21.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11502024-11-21T01:17:21.334ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11512024-11-21T01:17:21.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11522024-11-21T01:17:21.335ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11532024-11-21T01:17:21.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11542024-11-21T01:17:21.335ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11552024-11-21T01:17:21.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11562024-11-21T01:17:21.337ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11572024-11-21T01:17:21.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11582024-11-21T01:17:21.337ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11592024-11-21T01:17:21.339ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11602024-11-21T01:17:21.339ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11612024-11-21T01:17:21.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11622024-11-21T01:17:21.339ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11632024-11-21T01:17:21.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11642024-11-21T01:17:21.341ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11652024-11-21T01:17:21.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11662024-11-21T01:17:21.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.99682ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11672024-11-21T01:17:21.374ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
11682024-11-21T01:17:21.406ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
11692024-11-21T01:17:21.436ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
11702024-11-21T01:17:21.472ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
11712024-11-21T01:17:21.505ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
11722024-11-21T01:17:21.518ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8604ebd-a0b7-4899-a326-84358a19f8d5", "content-length": "64", "date": "Thu, 21 Nov 2024 01:17:21 GMT"} })
11732024-11-21T01:17:21.518ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11742024-11-21T01:17:21.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11752024-11-21T01:17:21.520ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11762024-11-21T01:17:21.521ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11772024-11-21T01:17:21.521ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11782024-11-21T01:17:21.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11792024-11-21T01:17:21.527ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed140347-95e7-4e27-aa90-1c22b174127a", "content-length": "64", "date": "Thu, 21 Nov 2024 01:17:21 GMT"} })
11802024-11-21T01:17:21.527ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11812024-11-21T01:17:21.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11822024-11-21T01:17:21.529ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11832024-11-21T01:17:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11842024-11-21T01:17:21.530ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11852024-11-21T01:17:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11862024-11-21T01:17:21.535ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fc15c59-eb17-481a-9956-c70d27ccee2c", "content-length": "64", "date": "Thu, 21 Nov 2024 01:17:21 GMT"} })
11872024-11-21T01:17:21.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11882024-11-21T01:17:21.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11892024-11-21T01:17:21.537ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11902024-11-21T01:17:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11912024-11-21T01:17:21.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11922024-11-21T01:17:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11932024-11-21T01:17:21.538ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "118ad7a4-8b66-4292-88bc-12f57cdb262a", "content-length": "64", "date": "Thu, 21 Nov 2024 01:17:21 GMT"} })
11942024-11-21T01:17:21.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11952024-11-21T01:17:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11962024-11-21T01:17:21.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11972024-11-21T01:17:21.541ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11982024-11-21T01:17:21.541ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11992024-11-21T01:17:21.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12002024-11-21T01:17:21.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9fe43c41-d742-440d-bbc0-7cfd91cb3bc5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12012024-11-21T01:17:21.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9fe43c41-d742-440d-bbc0-7cfd91cb3bc5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12022024-11-21T01:17:21.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9fe43c41-d742-440d-bbc0-7cfd91cb3bc5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12032024-11-21T01:17:21.612ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95fa5e93-6f4b-4e69-ad2f-90d0451a3c6c", "content-length": "64", "date": "Thu, 21 Nov 2024 01:17:21 GMT"} })
12042024-11-21T01:17:21.612ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12052024-11-21T01:17:21.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12062024-11-21T01:17:21.613ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12072024-11-21T01:17:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12082024-11-21T01:17:21.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12092024-11-21T01:17:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12102024-11-21T01:17:21.619ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 289.897975ms iteration = 2 status = {"nsuccess":5}
12112024-11-21T01:17:22.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa454f39-c493-49ee-9bba-1feb2284ca36 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12122024-11-21T01:17:22.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa454f39-c493-49ee-9bba-1feb2284ca36 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12132024-11-21T01:17:22.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa454f39-c493-49ee-9bba-1feb2284ca36 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12142024-11-21T01:17:23.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7cd9ae0-d65d-4c84-9bf0-209d7f86239d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12152024-11-21T01:17:23.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7cd9ae0-d65d-4c84-9bf0-209d7f86239d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12162024-11-21T01:17:23.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7cd9ae0-d65d-4c84-9bf0-209d7f86239d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12172024-11-21T01:17:24.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e987b203-57d4-47ef-8b82-3bfa295d4535 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12182024-11-21T01:17:24.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e987b203-57d4-47ef-8b82-3bfa295d4535 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12192024-11-21T01:17:24.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e987b203-57d4-47ef-8b82-3bfa295d4535 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12202024-11-21T01:17:25.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3fd69699-6ffd-42fd-9cf7-e6d1508340fd roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12212024-11-21T01:17:25.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3fd69699-6ffd-42fd-9cf7-e6d1508340fd resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12222024-11-21T01:17:25.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3fd69699-6ffd-42fd-9cf7-e6d1508340fd response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12232024-11-21T01:17:26.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 02346db3-2cab-4eb0-a13a-906ca011ef1f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12242024-11-21T01:17:26.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 02346db3-2cab-4eb0-a13a-906ca011ef1f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12252024-11-21T01:17:26.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 02346db3-2cab-4eb0-a13a-906ca011ef1f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12262024-11-21T01:17:27.162ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:45020
12272024-11-21T01:17:27.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 1234f4ad-6cf9-47ce-8eac-aed98597e6dd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12282024-11-21T01:17:27.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 1234f4ad-6cf9-47ce-8eac-aed98597e6dd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12292024-11-21T01:17:27.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 1234f4ad-6cf9-47ce-8eac-aed98597e6dd response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12302024-11-21T01:17:27.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8ade3825-6b45-4c7c-86d3-a8b044e1b356 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12312024-11-21T01:17:27.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8ade3825-6b45-4c7c-86d3-a8b044e1b356 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12322024-11-21T01:17:27.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8ade3825-6b45-4c7c-86d3-a8b044e1b356 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12332024-11-21T01:17:27.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7c42e842-257a-4da1-bf04-89b9f7f2c17c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12342024-11-21T01:17:27.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7c42e842-257a-4da1-bf04-89b9f7f2c17c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12352024-11-21T01:17:27.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7c42e842-257a-4da1-bf04-89b9f7f2c17c response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12362024-11-21T01:17:27.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 2652bf1a-1925-440b-a6a0-1baa07e56539 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12372024-11-21T01:17:27.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 2652bf1a-1925-440b-a6a0-1baa07e56539 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12382024-11-21T01:17:27.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 2652bf1a-1925-440b-a6a0-1baa07e56539 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12392024-11-21T01:17:27.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = b1573aef-ef52-49cc-9bf8-cda55f9994c0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12402024-11-21T01:17:27.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = b1573aef-ef52-49cc-9bf8-cda55f9994c0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12412024-11-21T01:17:27.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = b1573aef-ef52-49cc-9bf8-cda55f9994c0 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12422024-11-21T01:17:27.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8c8c437d-1b6b-4a35-881f-47aabcbf8ff3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12432024-11-21T01:17:27.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8c8c437d-1b6b-4a35-881f-47aabcbf8ff3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12442024-11-21T01:17:27.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8c8c437d-1b6b-4a35-881f-47aabcbf8ff3 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12452024-11-21T01:17:27.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = fc1aec66-edad-41aa-b445-5caff5d42d94 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
12462024-11-21T01:17:27.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = fc1aec66-edad-41aa-b445-5caff5d42d94 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
12472024-11-21T01:17:27.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = fc1aec66-edad-41aa-b445-5caff5d42d94 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
12482024-11-21T01:17:27.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f998f70b-5799-4494-a277-2b331849badb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12492024-11-21T01:17:27.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f998f70b-5799-4494-a277-2b331849badb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12502024-11-21T01:17:27.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f998f70b-5799-4494-a277-2b331849badb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12512024-11-21T01:17:28.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 63023342-d354-416c-a03b-5fa75b22952f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12522024-11-21T01:17:28.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 63023342-d354-416c-a03b-5fa75b22952f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12532024-11-21T01:17:28.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 63023342-d354-416c-a03b-5fa75b22952f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12542024-11-21T01:17:29.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e085a2f-5338-4f3d-a4f0-2a6bff7288c4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12552024-11-21T01:17:29.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e085a2f-5338-4f3d-a4f0-2a6bff7288c4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12562024-11-21T01:17:29.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e085a2f-5338-4f3d-a4f0-2a6bff7288c4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12572024-11-21T01:17:30.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94e214de-d224-40c4-8e5d-f06b6d2eadd9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12582024-11-21T01:17:30.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94e214de-d224-40c4-8e5d-f06b6d2eadd9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12592024-11-21T01:17:30.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94e214de-d224-40c4-8e5d-f06b6d2eadd9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12602024-11-21T01:17:31.300ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
12612024-11-21T01:17:31.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12622024-11-21T01:17:31.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12632024-11-21T01:17:31.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
12642024-11-21T01:17:31.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12652024-11-21T01:17:31.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12662024-11-21T01:17:31.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672024-11-21T01:17:31.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12682024-11-21T01:17:31.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12692024-11-21T01:17:31.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12702024-11-21T01:17:31.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12712024-11-21T01:17:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12722024-11-21T01:17:31.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12732024-11-21T01:17:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
12742024-11-21T01:17:31.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12752024-11-21T01:17:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12762024-11-21T01:17:31.331ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12772024-11-21T01:17:31.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12782024-11-21T01:17:31.332ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
12792024-11-21T01:17:31.332ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.018851ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
12802024-11-21T01:17:31.360ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.691867ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12812024-11-21T01:17:31.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 101d51a6-d1da-4810-baab-41c9fb1cd43a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12822024-11-21T01:17:31.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 101d51a6-d1da-4810-baab-41c9fb1cd43a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12832024-11-21T01:17:31.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 101d51a6-d1da-4810-baab-41c9fb1cd43a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12842024-11-21T01:17:32.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8a6565f1-37e2-4c07-b6d4-7ccfff1e4387 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12852024-11-21T01:17:32.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8a6565f1-37e2-4c07-b6d4-7ccfff1e4387 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12862024-11-21T01:17:32.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8a6565f1-37e2-4c07-b6d4-7ccfff1e4387 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12872024-11-21T01:17:33.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07785a52-7b4b-4ea1-9be5-408500b1c950 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12882024-11-21T01:17:33.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07785a52-7b4b-4ea1-9be5-408500b1c950 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12892024-11-21T01:17:33.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07785a52-7b4b-4ea1-9be5-408500b1c950 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12902024-11-21T01:17:34.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa60b842-333a-4734-810c-991d7137cc69 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12912024-11-21T01:17:34.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa60b842-333a-4734-810c-991d7137cc69 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12922024-11-21T01:17:34.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa60b842-333a-4734-810c-991d7137cc69 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12932024-11-21T01:17:35.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 64da5c8b-92fc-40e8-8b90-592df1a0bf68 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12942024-11-21T01:17:35.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 64da5c8b-92fc-40e8-8b90-592df1a0bf68 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12952024-11-21T01:17:35.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 64da5c8b-92fc-40e8-8b90-592df1a0bf68 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12962024-11-21T01:17:36.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b956c1a4-fe8c-40f8-84f4-15a9f4c3bbc7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12972024-11-21T01:17:36.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b956c1a4-fe8c-40f8-84f4-15a9f4c3bbc7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12982024-11-21T01:17:36.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b956c1a4-fe8c-40f8-84f4-15a9f4c3bbc7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
12992024-11-21T01:17:37.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = be11210f-5600-450b-a015-843e7207a911 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13002024-11-21T01:17:37.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = be11210f-5600-450b-a015-843e7207a911 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13012024-11-21T01:17:37.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = be11210f-5600-450b-a015-843e7207a911 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13022024-11-21T01:17:38.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fe125a5e-4e9f-4d92-bb6e-c0d1c7ef4bd1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13032024-11-21T01:17:38.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fe125a5e-4e9f-4d92-bb6e-c0d1c7ef4bd1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13042024-11-21T01:17:38.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fe125a5e-4e9f-4d92-bb6e-c0d1c7ef4bd1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13052024-11-21T01:17:40.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d2244c52-7d81-4f12-8f30-74c690eaa18c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13062024-11-21T01:17:40.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d2244c52-7d81-4f12-8f30-74c690eaa18c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13072024-11-21T01:17:40.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d2244c52-7d81-4f12-8f30-74c690eaa18c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13082024-11-21T01:17:41.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 50e6faf6-592b-438f-b03d-518e50947ab6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13092024-11-21T01:17:41.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 50e6faf6-592b-438f-b03d-518e50947ab6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13102024-11-21T01:17:41.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 50e6faf6-592b-438f-b03d-518e50947ab6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
13112024-11-21T01:17:41.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8264ffb5-7f0f-43fa-9cfa-f1a22899067e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
13122024-11-21T01:17:41.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8264ffb5-7f0f-43fa-9cfa-f1a22899067e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
13132024-11-21T01:17:41.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 8264ffb5-7f0f-43fa-9cfa-f1a22899067e response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
13142024-11-21T01:17:41.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 0bef3929-471c-4079-a7b7-6b3eaaf75375 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13152024-11-21T01:17:41.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 0bef3929-471c-4079-a7b7-6b3eaaf75375 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13162024-11-21T01:17:41.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 0bef3929-471c-4079-a7b7-6b3eaaf75375 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13172024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
13182024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
13192024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13202024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13212024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
13222024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
13232024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13242024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13252024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
13262024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13272024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
13282024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
13292024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13302024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
13312024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13322024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
13332024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13342024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
13352024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13362024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
13372024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13382024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
13392024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13402024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13412024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
13422024-11-21T01:17:41.301ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13432024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13442024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13452024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13462024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13472024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13482024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13492024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13502024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13512024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13522024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13532024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13542024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13552024-11-21T01:17:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13562024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
13572024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
13582024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13592024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13602024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
13612024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13622024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
13632024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13642024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13652024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13662024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13672024-11-21T01:17:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13682024-11-21T01:17:41.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13692024-11-21T01:17:41.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1040, tv_nsec: 204747059 } })
13702024-11-21T01:17:41.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1040, tv_nsec: 204768469 } })
13712024-11-21T01:17:41.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13722024-11-21T01:17:41.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
13732024-11-21T01:17:41.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
13742024-11-21T01:17:41.305ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.516624ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13752024-11-21T01:17:41.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13762024-11-21T01:17:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13772024-11-21T01:17:41.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13782024-11-21T01:17:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13792024-11-21T01:17:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13802024-11-21T01:17:41.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13812024-11-21T01:17:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13822024-11-21T01:17:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13832024-11-21T01:17:41.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13842024-11-21T01:17:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13852024-11-21T01:17:41.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13862024-11-21T01:17:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13872024-11-21T01:17:41.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13882024-11-21T01:17:41.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13892024-11-21T01:17:41.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13902024-11-21T01:17:41.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13912024-11-21T01:17:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13922024-11-21T01:17:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13932024-11-21T01:17:41.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13942024-11-21T01:17:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13952024-11-21T01:17:41.315ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13962024-11-21T01:17:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13972024-11-21T01:17:41.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13982024-11-21T01:17:41.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13992024-11-21T01:17:41.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002024-11-21T01:17:41.323ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.500123ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14012024-11-21T01:17:41.323ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14022024-11-21T01:17:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14032024-11-21T01:17:41.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14042024-11-21T01:17:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14052024-11-21T01:17:41.323ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1040, tv_nsec: 223440703 } })
14062024-11-21T01:17:41.324ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
14072024-11-21T01:17:41.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14082024-11-21T01:17:41.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14092024-11-21T01:17:41.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14102024-11-21T01:17:41.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14112024-11-21T01:17:41.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14122024-11-21T01:17:41.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14132024-11-21T01:17:41.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14142024-11-21T01:17:41.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14152024-11-21T01:17:41.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
14162024-11-21T01:17:41.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14172024-11-21T01:17:41.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14182024-11-21T01:17:41.343ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192024-11-21T01:17:41.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14202024-11-21T01:17:41.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14212024-11-21T01:17:41.346ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14222024-11-21T01:17:41.346ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14232024-11-21T01:17:41.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14242024-11-21T01:17:41.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14252024-11-21T01:17:41.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14262024-11-21T01:17:41.348ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14272024-11-21T01:17:41.348ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14282024-11-21T01:17:41.348ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14292024-11-21T01:17:41.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14302024-11-21T01:17:41.351ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14312024-11-21T01:17:41.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14322024-11-21T01:17:41.352ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
14332024-11-21T01:17:41.352ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.218002ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
14342024-11-21T01:17:41.352ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
14352024-11-21T01:17:41.352ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14362024-11-21T01:17:41.353ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d265f587-0544-4bb8-91bd-b55dd6c20e6d", "content-length": "26", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
14372024-11-21T01:17:41.353ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14382024-11-21T01:17:41.353ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14392024-11-21T01:17:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14402024-11-21T01:17:41.353ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
14412024-11-21T01:17:41.353ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14422024-11-21T01:17:41.354ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5f93068-6170-4cf7-a25d-9e6bdbff7972", "content-length": "26", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
14432024-11-21T01:17:41.354ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14442024-11-21T01:17:41.355ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14452024-11-21T01:17:41.356ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14462024-11-21T01:17:41.361ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14472024-11-21T01:17:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14482024-11-21T01:17:41.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.542099ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
14492024-11-21T01:17:41.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.29398ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
14502024-11-21T01:17:41.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.068445ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
14512024-11-21T01:17:41.390ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14522024-11-21T01:17:41.390ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.525708ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14532024-11-21T01:17:41.392ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 91.404988ms iteration = 4 status = {"physical_disks_added":0}
14542024-11-21T01:17:41.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.709452ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14552024-11-21T01:17:41.395ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
14562024-11-21T01:17:41.395ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14572024-11-21T01:17:41.396ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c6194a8-519d-40eb-88d3-744bdd1f7448", "content-length": "26", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
14582024-11-21T01:17:41.396ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14592024-11-21T01:17:41.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 95.07534ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14602024-11-21T01:17:41.397ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
14612024-11-21T01:17:41.401ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14622024-11-21T01:17:41.401ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14632024-11-21T01:17:41.401ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.748625ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14642024-11-21T01:17:41.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14652024-11-21T01:17:41.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14662024-11-21T01:17:41.434ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 133.325359ms iteration = 2 status = {}
14672024-11-21T01:17:41.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14682024-11-21T01:17:41.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14692024-11-21T01:17:41.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-11-21T01:17:41.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14712024-11-21T01:17:41.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14722024-11-21T01:17:41.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14732024-11-21T01:17:41.461ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742024-11-21T01:17:41.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14752024-11-21T01:17:41.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14762024-11-21T01:17:41.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14772024-11-21T01:17:41.488ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14782024-11-21T01:17:41.488ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c1bd6ac-cbb5-4f14-83ec-ec0196691a15", "content-length": "1", "date": "Thu, 21 Nov 2024 01:17:40 GMT"} })
14792024-11-21T01:17:41.489ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14802024-11-21T01:17:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14812024-11-21T01:17:41.501ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14822024-11-21T01:17:41.501ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14832024-11-21T01:17:41.501ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "316e7a72-ad74-4439-b80a-d7a13638a3f2", "content-length": "372", "date": "Thu, 21 Nov 2024 01:17:40 GMT"} })
14842024-11-21T01:17:41.503ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 201.826034ms iteration = 2 status = null
14852024-11-21T01:17:41.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14862024-11-21T01:17:41.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14872024-11-21T01:17:41.540ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14882024-11-21T01:17:41.541ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fd5cabe-15b1-4b54-aa87-657ce8d85f18", "content-length": "691", "date": "Thu, 21 Nov 2024 01:17:40 GMT"} })
14892024-11-21T01:17:41.543ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14902024-11-21T01:17:41.543ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14912024-11-21T01:17:41.543ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14922024-11-21T01:17:41.544ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 243.297119ms iteration = 2 status = {}
14932024-11-21T01:17:41.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14942024-11-21T01:17:41.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14952024-11-21T01:17:41.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14962024-11-21T01:17:41.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14972024-11-21T01:17:41.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14982024-11-21T01:17:41.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14992024-11-21T01:17:41.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15002024-11-21T01:17:41.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
15012024-11-21T01:17:41.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15022024-11-21T01:17:41.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15032024-11-21T01:17:41.604ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 303.402866ms iteration = 2 status = 0
15042024-11-21T01:17:41.604ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
15052024-11-21T01:17:41.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15062024-11-21T01:17:41.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15072024-11-21T01:17:41.618ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15082024-11-21T01:17:41.618ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15092024-11-21T01:17:41.618ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f082b4a3-909e-48e8-bb32-be38f2946550", "content-length": "134", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
15102024-11-21T01:17:41.618ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15112024-11-21T01:17:41.624ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15122024-11-21T01:17:41.624ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
15132024-11-21T01:17:41.627ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15142024-11-21T01:17:41.627ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15152024-11-21T01:17:41.627ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15162024-11-21T01:17:41.627ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15172024-11-21T01:17:41.627ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15182024-11-21T01:17:41.627ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15192024-11-21T01:17:41.627ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15202024-11-21T01:17:41.627ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15212024-11-21T01:17:41.628ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
15222024-11-21T01:17:41.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15232024-11-21T01:17:41.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15242024-11-21T01:17:41.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15252024-11-21T01:17:41.637ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "727e037a-bb7a-4cbb-98da-cc7313b3e13b", "content-length": "2", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
15262024-11-21T01:17:41.637ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15272024-11-21T01:17:41.637ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a35b176-2fb0-443e-b7dd-9614af5fb858", "content-length": "51", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
15282024-11-21T01:17:41.637ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
15292024-11-21T01:17:41.637ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15302024-11-21T01:17:41.647ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7407b77e-f2bc-446d-81a6-17077e546cb0", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
15312024-11-21T01:17:41.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15322024-11-21T01:17:41.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15332024-11-21T01:17:41.650ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15342024-11-21T01:17:41.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15352024-11-21T01:17:41.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15362024-11-21T01:17:41.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15372024-11-21T01:17:41.657ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15382024-11-21T01:17:41.657ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15392024-11-21T01:17:41.658ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bd26673b-220e-4fc4-9269-9d9139a687f8", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
15402024-11-21T01:17:41.660ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 358.718505ms iteration = 2 status = {}
15412024-11-21T01:17:41.746ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "346e569c-d69b-4950-b289-7fcb4d5802f0", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
15422024-11-21T01:17:41.746ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
15432024-11-21T01:17:41.746ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15442024-11-21T01:17:41.746ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "94bc63b2-f916-4d71-9c27-6f890fef2266", "content-length": "682", "date": "Thu, 21 Nov 2024 01:17:41 GMT"} })
15452024-11-21T01:17:41.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15462024-11-21T01:17:41.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15472024-11-21T01:17:41.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15482024-11-21T01:17:41.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15492024-11-21T01:17:41.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15502024-11-21T01:17:41.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15512024-11-21T01:17:41.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15522024-11-21T01:17:41.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15532024-11-21T01:17:41.766ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 464.696788ms iteration = 2 status = {}
15542024-11-21T01:17:42.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 659aa87b-715e-4e47-a3ae-c166723d7957 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15552024-11-21T01:17:42.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 659aa87b-715e-4e47-a3ae-c166723d7957 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15562024-11-21T01:17:42.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 659aa87b-715e-4e47-a3ae-c166723d7957 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15572024-11-21T01:17:43.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2db6a826-95bf-4094-8f10-776039047e7f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15582024-11-21T01:17:43.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2db6a826-95bf-4094-8f10-776039047e7f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15592024-11-21T01:17:43.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2db6a826-95bf-4094-8f10-776039047e7f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15602024-11-21T01:17:44.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 644aa6f8-9653-47be-86f5-f005b91e52ae roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15612024-11-21T01:17:44.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 644aa6f8-9653-47be-86f5-f005b91e52ae resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15622024-11-21T01:17:44.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 644aa6f8-9653-47be-86f5-f005b91e52ae response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15632024-11-21T01:17:45.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 764f5444-d15e-461a-a95d-9f2d83d71ec3 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15642024-11-21T01:17:45.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 764f5444-d15e-461a-a95d-9f2d83d71ec3 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15652024-11-21T01:17:45.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 764f5444-d15e-461a-a95d-9f2d83d71ec3 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15662024-11-21T01:17:46.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5d3d56e-dd61-4e17-8046-4010493cc919 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15672024-11-21T01:17:46.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5d3d56e-dd61-4e17-8046-4010493cc919 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15682024-11-21T01:17:46.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5d3d56e-dd61-4e17-8046-4010493cc919 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15692024-11-21T01:17:47.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94176e14-b236-4371-bdfe-15a36af23479 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15702024-11-21T01:17:47.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94176e14-b236-4371-bdfe-15a36af23479 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15712024-11-21T01:17:47.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94176e14-b236-4371-bdfe-15a36af23479 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15722024-11-21T01:17:48.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3295962f-beca-4755-b8a7-86345f16d7ae roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15732024-11-21T01:17:48.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3295962f-beca-4755-b8a7-86345f16d7ae resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15742024-11-21T01:17:48.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3295962f-beca-4755-b8a7-86345f16d7ae response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15752024-11-21T01:17:49.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aba5048c-eb40-4571-86fc-567c6c6f5181 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15762024-11-21T01:17:49.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aba5048c-eb40-4571-86fc-567c6c6f5181 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15772024-11-21T01:17:49.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aba5048c-eb40-4571-86fc-567c6c6f5181 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15782024-11-21T01:17:50.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e9d0d532-8379-42d6-9ba9-d4d2a66f886f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15792024-11-21T01:17:50.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e9d0d532-8379-42d6-9ba9-d4d2a66f886f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15802024-11-21T01:17:50.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e9d0d532-8379-42d6-9ba9-d4d2a66f886f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15812024-11-21T01:17:51.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7f80caf1-de6c-483e-b2b4-3dc1f79d6cb8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15822024-11-21T01:17:51.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7f80caf1-de6c-483e-b2b4-3dc1f79d6cb8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15832024-11-21T01:17:51.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7f80caf1-de6c-483e-b2b4-3dc1f79d6cb8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
15842024-11-21T01:17:51.300ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
15852024-11-21T01:17:51.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15862024-11-21T01:17:51.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15872024-11-21T01:17:51.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
15882024-11-21T01:17:51.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15892024-11-21T01:17:51.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-11-21T01:17:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15912024-11-21T01:17:51.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15922024-11-21T01:17:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15932024-11-21T01:17:51.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15942024-11-21T01:17:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15952024-11-21T01:17:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15962024-11-21T01:17:51.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.105312ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15972024-11-21T01:17:51.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15982024-11-21T01:17:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15992024-11-21T01:17:51.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16002024-11-21T01:17:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
16012024-11-21T01:17:51.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16022024-11-21T01:17:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16032024-11-21T01:17:51.425ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
16042024-11-21T01:17:51.425ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.616796ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
16052024-11-21T01:17:52.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0abe110a-949e-42dd-945f-033a0cb8bc3c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16062024-11-21T01:17:52.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0abe110a-949e-42dd-945f-033a0cb8bc3c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16072024-11-21T01:17:52.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0abe110a-949e-42dd-945f-033a0cb8bc3c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16082024-11-21T01:17:53.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f731165-f85c-45a9-bce1-41ac72e6d114 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16092024-11-21T01:17:53.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f731165-f85c-45a9-bce1-41ac72e6d114 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16102024-11-21T01:17:53.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f731165-f85c-45a9-bce1-41ac72e6d114 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16112024-11-21T01:17:54.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 16eb47d4-c7e6-4c73-a329-1f95164c43c4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16122024-11-21T01:17:54.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 16eb47d4-c7e6-4c73-a329-1f95164c43c4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16132024-11-21T01:17:54.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 16eb47d4-c7e6-4c73-a329-1f95164c43c4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16142024-11-21T01:17:55.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c155bc38-d544-492f-9b81-4e5d39b1cd8f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16152024-11-21T01:17:55.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c155bc38-d544-492f-9b81-4e5d39b1cd8f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16162024-11-21T01:17:55.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c155bc38-d544-492f-9b81-4e5d39b1cd8f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16172024-11-21T01:17:56.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2fdea6c9-167e-4981-9c0d-da728f7e30c2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16182024-11-21T01:17:56.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2fdea6c9-167e-4981-9c0d-da728f7e30c2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16192024-11-21T01:17:56.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2fdea6c9-167e-4981-9c0d-da728f7e30c2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16202024-11-21T01:17:57.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5327388-59f3-4348-8b1d-8ff0defdd7ec roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16212024-11-21T01:17:57.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5327388-59f3-4348-8b1d-8ff0defdd7ec resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16222024-11-21T01:17:57.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5327388-59f3-4348-8b1d-8ff0defdd7ec response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16232024-11-21T01:17:58.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f97f1f39-2fc2-40f2-97cd-49c01f9793a7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16242024-11-21T01:17:58.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f97f1f39-2fc2-40f2-97cd-49c01f9793a7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16252024-11-21T01:17:58.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f97f1f39-2fc2-40f2-97cd-49c01f9793a7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16262024-11-21T01:17:59.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2e554455-9498-466e-906d-c0a111c102c2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16272024-11-21T01:17:59.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2e554455-9498-466e-906d-c0a111c102c2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16282024-11-21T01:17:59.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2e554455-9498-466e-906d-c0a111c102c2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16292024-11-21T01:18:00.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d13ee70e-3af3-4a12-9f23-79c0a12db32d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16302024-11-21T01:18:00.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d13ee70e-3af3-4a12-9f23-79c0a12db32d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16312024-11-21T01:18:00.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d13ee70e-3af3-4a12-9f23-79c0a12db32d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16322024-11-21T01:18:01.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
16332024-11-21T01:18:01.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16342024-11-21T01:18:01.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16352024-11-21T01:18:01.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
16362024-11-21T01:18:01.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16372024-11-21T01:18:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16382024-11-21T01:18:01.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16392024-11-21T01:18:01.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16402024-11-21T01:18:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16412024-11-21T01:18:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16422024-11-21T01:18:01.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16432024-11-21T01:18:01.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.858955ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16442024-11-21T01:18:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16452024-11-21T01:18:01.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16462024-11-21T01:18:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16472024-11-21T01:18:01.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16482024-11-21T01:18:01.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
16492024-11-21T01:18:01.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16502024-11-21T01:18:01.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16512024-11-21T01:18:01.320ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
16522024-11-21T01:18:01.320ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.496795ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
16532024-11-21T01:18:01.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2c89bd33-9d1a-4142-b9e3-4807b946a7ac roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16542024-11-21T01:18:01.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2c89bd33-9d1a-4142-b9e3-4807b946a7ac resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16552024-11-21T01:18:01.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2c89bd33-9d1a-4142-b9e3-4807b946a7ac response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16562024-11-21T01:18:02.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c8008893-a3ad-48af-90a5-8b64cec0fee0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16572024-11-21T01:18:02.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c8008893-a3ad-48af-90a5-8b64cec0fee0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16582024-11-21T01:18:02.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c8008893-a3ad-48af-90a5-8b64cec0fee0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16592024-11-21T01:18:03.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fba1ec98-192c-474d-af47-df99d50a2a3f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16602024-11-21T01:18:03.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fba1ec98-192c-474d-af47-df99d50a2a3f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16612024-11-21T01:18:03.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fba1ec98-192c-474d-af47-df99d50a2a3f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16622024-11-21T01:18:04.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 18c15285-6937-4a17-9abe-b46438e11d39 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16632024-11-21T01:18:04.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 18c15285-6937-4a17-9abe-b46438e11d39 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16642024-11-21T01:18:04.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 18c15285-6937-4a17-9abe-b46438e11d39 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16652024-11-21T01:18:05.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2faccd18-35ec-49f0-9824-7959d4d92c13 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16662024-11-21T01:18:05.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2faccd18-35ec-49f0-9824-7959d4d92c13 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16672024-11-21T01:18:05.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2faccd18-35ec-49f0-9824-7959d4d92c13 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16682024-11-21T01:18:06.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3039b23d-b2d6-4444-afbc-6ea5d54e5ba7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16692024-11-21T01:18:06.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3039b23d-b2d6-4444-afbc-6ea5d54e5ba7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16702024-11-21T01:18:06.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3039b23d-b2d6-4444-afbc-6ea5d54e5ba7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16712024-11-21T01:18:07.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45a33a49-5efe-47e5-9f65-35ed07ead4e5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16722024-11-21T01:18:07.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45a33a49-5efe-47e5-9f65-35ed07ead4e5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16732024-11-21T01:18:07.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45a33a49-5efe-47e5-9f65-35ed07ead4e5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16742024-11-21T01:18:08.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b006ad84-2936-4509-88b2-00660d464ebc roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16752024-11-21T01:18:08.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b006ad84-2936-4509-88b2-00660d464ebc resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16762024-11-21T01:18:08.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b006ad84-2936-4509-88b2-00660d464ebc response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16772024-11-21T01:18:09.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9ea669f8-019a-4032-96b8-166baeb3c1aa roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16782024-11-21T01:18:09.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9ea669f8-019a-4032-96b8-166baeb3c1aa resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16792024-11-21T01:18:09.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9ea669f8-019a-4032-96b8-166baeb3c1aa response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16802024-11-21T01:18:10.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f3bf17a-399e-4883-80e6-f6fc484b3477 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16812024-11-21T01:18:10.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f3bf17a-399e-4883-80e6-f6fc484b3477 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16822024-11-21T01:18:10.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f3bf17a-399e-4883-80e6-f6fc484b3477 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
16832024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
16842024-11-21T01:18:11.301ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
16852024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.441\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
16862024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
16872024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
16882024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16892024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
16902024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
16912024-11-21T01:18:11.301ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16922024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 7.66\u{b5}s iteration = 3 status = {"error":"no config"}
16932024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
16942024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
16952024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16962024-11-21T01:18:11.301ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:08:11.301076433 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16972024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
16982024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16992024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17002024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17012024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
17022024-11-21T01:18:11.301ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17032024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
17042024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17052024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
17062024-11-21T01:18:11.301ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
17072024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.53\u{b5}s iteration = 3 status = {"error":"no config"}
17082024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17092024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
17102024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17112024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
17122024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
17132024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17142024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17152024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
17162024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17172024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17182024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
17192024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17202024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
17212024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
17222024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17232024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
17242024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17252024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17262024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17272024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17282024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17292024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
17302024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17312024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
17322024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17332024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17342024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17352024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17362024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17372024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
17382024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
17392024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
17402024-11-21T01:18:11.301ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17412024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17422024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17432024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17442024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17452024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17462024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17472024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17482024-11-21T01:18:11.301ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 201335501 } })
17492024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17502024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17512024-11-21T01:18:11.301ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 201370112 } })
17522024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17532024-11-21T01:18:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17542024-11-21T01:18:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17552024-11-21T01:18:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17562024-11-21T01:18:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17572024-11-21T01:18:11.302ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
17582024-11-21T01:18:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.129496ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
17592024-11-21T01:18:11.302ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
17602024-11-21T01:18:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.39731ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
17612024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
17622024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
17632024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17642024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
17652024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17662024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17672024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
17682024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17692024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
17702024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17712024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
17722024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17732024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17742024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17752024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17762024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17772024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17782024-11-21T01:18:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17792024-11-21T01:18:11.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = d871b32b-e365-451c-8222-c117c3f831b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17802024-11-21T01:18:11.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = d871b32b-e365-451c-8222-c117c3f831b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17812024-11-21T01:18:11.303ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 203467441 } })
17822024-11-21T01:18:11.304ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
17832024-11-21T01:18:11.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17842024-11-21T01:18:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.916076ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17852024-11-21T01:18:11.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17862024-11-21T01:18:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17872024-11-21T01:18:11.305ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882024-11-21T01:18:11.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17892024-11-21T01:18:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17902024-11-21T01:18:11.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17912024-11-21T01:18:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17922024-11-21T01:18:11.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17932024-11-21T01:18:11.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17942024-11-21T01:18:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17952024-11-21T01:18:11.307ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17962024-11-21T01:18:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17972024-11-21T01:18:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17982024-11-21T01:18:11.308ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 208461112 } })
17992024-11-21T01:18:11.309ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
18002024-11-21T01:18:11.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18012024-11-21T01:18:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18022024-11-21T01:18:11.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18032024-11-21T01:18:11.310ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:08:11.301076433 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18042024-11-21T01:18:11.310ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.310202ms iteration = 2 status = {"expiration":"2024-11-21T01:08:11.301076433Z","pruned":[]}
18052024-11-21T01:18:11.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18062024-11-21T01:18:11.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18072024-11-21T01:18:11.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18082024-11-21T01:18:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18092024-11-21T01:18:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18102024-11-21T01:18:11.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18112024-11-21T01:18:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18122024-11-21T01:18:11.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18132024-11-21T01:18:11.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18142024-11-21T01:18:11.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18152024-11-21T01:18:11.317ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18162024-11-21T01:18:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18172024-11-21T01:18:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18182024-11-21T01:18:11.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18192024-11-21T01:18:11.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.493493ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
18202024-11-21T01:18:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18212024-11-21T01:18:11.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18222024-11-21T01:18:11.321ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.908692ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
18232024-11-21T01:18:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18242024-11-21T01:18:11.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.347188ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
18252024-11-21T01:18:11.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18262024-11-21T01:18:11.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = d871b32b-e365-451c-8222-c117c3f831b1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
18272024-11-21T01:18:11.322ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18282024-11-21T01:18:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18292024-11-21T01:18:11.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18302024-11-21T01:18:11.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18312024-11-21T01:18:11.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18322024-11-21T01:18:11.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18332024-11-21T01:18:11.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18342024-11-21T01:18:11.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352024-11-21T01:18:11.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18362024-11-21T01:18:11.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18372024-11-21T01:18:11.334ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18382024-11-21T01:18:11.334ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 32.443337ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18392024-11-21T01:18:11.335ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18402024-11-21T01:18:11.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18412024-11-21T01:18:11.336ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422024-11-21T01:18:11.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18432024-11-21T01:18:11.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18442024-11-21T01:18:11.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18452024-11-21T01:18:11.338ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18462024-11-21T01:18:11.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18472024-11-21T01:18:11.339ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18482024-11-21T01:18:11.339ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18492024-11-21T01:18:11.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18502024-11-21T01:18:11.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18512024-11-21T01:18:11.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18522024-11-21T01:18:11.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18532024-11-21T01:18:11.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18542024-11-21T01:18:11.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18552024-11-21T01:18:11.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18562024-11-21T01:18:11.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18572024-11-21T01:18:11.357ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18582024-11-21T01:18:11.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18592024-11-21T01:18:11.357ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18602024-11-21T01:18:11.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18612024-11-21T01:18:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
18622024-11-21T01:18:11.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18632024-11-21T01:18:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18642024-11-21T01:18:11.360ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18652024-11-21T01:18:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18662024-11-21T01:18:11.362ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18672024-11-21T01:18:11.362ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18682024-11-21T01:18:11.362ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18692024-11-21T01:18:11.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18702024-11-21T01:18:11.363ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18712024-11-21T01:18:11.363ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18722024-11-21T01:18:11.363ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.860768ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
18732024-11-21T01:18:11.365ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
18742024-11-21T01:18:11.365ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
18752024-11-21T01:18:11.365ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.337147ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
18762024-11-21T01:18:11.367ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18772024-11-21T01:18:11.367ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18782024-11-21T01:18:11.367ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18792024-11-21T01:18:11.367ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18802024-11-21T01:18:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18812024-11-21T01:18:11.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18822024-11-21T01:18:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18832024-11-21T01:18:11.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.843915ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18842024-11-21T01:18:11.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18852024-11-21T01:18:11.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
18862024-11-21T01:18:11.374ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18872024-11-21T01:18:11.375ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a62ff4f-f4f8-4a82-85b8-941a6a7be860", "content-length": "26", "date": "Thu, 21 Nov 2024 01:18:10 GMT"} })
18882024-11-21T01:18:11.375ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18892024-11-21T01:18:11.376ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18902024-11-21T01:18:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18912024-11-21T01:18:11.378ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18922024-11-21T01:18:11.378ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18932024-11-21T01:18:11.378ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18942024-11-21T01:18:11.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18952024-11-21T01:18:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18962024-11-21T01:18:11.384ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18972024-11-21T01:18:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18982024-11-21T01:18:11.392ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
18992024-11-21T01:18:11.392ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19002024-11-21T01:18:11.392ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "929dc9c5-65d1-4304-8ba4-97a3996fc9b0", "content-length": "26", "date": "Thu, 21 Nov 2024 01:18:10 GMT"} })
19012024-11-21T01:18:11.392ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19022024-11-21T01:18:11.393ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19032024-11-21T01:18:11.426ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
19042024-11-21T01:18:11.426ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 124.564765ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
19052024-11-21T01:18:11.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1070, tv_nsec: 326766509 } })
19062024-11-21T01:18:11.427ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19072024-11-21T01:18:11.427ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19082024-11-21T01:18:11.427ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
19092024-11-21T01:18:11.427ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b97d328e-9f48-413b-b6d0-aaf99a333eb8", "content-length": "372", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
19102024-11-21T01:18:11.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19112024-11-21T01:18:11.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19122024-11-21T01:18:11.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 128.076675ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19132024-11-21T01:18:11.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19142024-11-21T01:18:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19152024-11-21T01:18:11.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19162024-11-21T01:18:11.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19172024-11-21T01:18:11.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19182024-11-21T01:18:11.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19192024-11-21T01:18:11.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19202024-11-21T01:18:11.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19212024-11-21T01:18:11.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19222024-11-21T01:18:11.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19232024-11-21T01:18:11.445ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
19242024-11-21T01:18:11.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 144.529046ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
19252024-11-21T01:18:11.450ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 149.239453ms iteration = 5 status = {"physical_disks_added":0}
19262024-11-21T01:18:11.455ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19272024-11-21T01:18:11.456ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec83f644-922a-47c6-bc41-a09e3fdd50b7", "content-length": "1", "date": "Thu, 21 Nov 2024 01:18:10 GMT"} })
19282024-11-21T01:18:11.457ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19292024-11-21T01:18:11.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19302024-11-21T01:18:11.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 162.386599ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19312024-11-21T01:18:11.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19322024-11-21T01:18:11.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19332024-11-21T01:18:11.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19342024-11-21T01:18:11.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19352024-11-21T01:18:11.469ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 168.782048ms iteration = 3 status = null
19362024-11-21T01:18:11.474ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.920167ms iteration = 3 status = {}
19372024-11-21T01:18:11.474ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19382024-11-21T01:18:11.474ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19392024-11-21T01:18:11.474ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19402024-11-21T01:18:11.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19412024-11-21T01:18:11.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 173.969001ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19422024-11-21T01:18:11.479ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19432024-11-21T01:18:11.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19442024-11-21T01:18:11.479ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19452024-11-21T01:18:11.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19462024-11-21T01:18:11.480ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19472024-11-21T01:18:11.480ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
19482024-11-21T01:18:11.480ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19492024-11-21T01:18:11.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19502024-11-21T01:18:11.481ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19512024-11-21T01:18:11.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19522024-11-21T01:18:11.482ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532024-11-21T01:18:11.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542024-11-21T01:18:11.485ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
19552024-11-21T01:18:11.485ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19562024-11-21T01:18:11.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19572024-11-21T01:18:11.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19582024-11-21T01:18:11.485ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19592024-11-21T01:18:11.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19602024-11-21T01:18:11.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19612024-11-21T01:18:11.485ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "498cba8d-fbbf-4e8e-a202-0759f86e3968", "content-length": "26", "date": "Thu, 21 Nov 2024 01:18:10 GMT"} })
19622024-11-21T01:18:11.485ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19632024-11-21T01:18:11.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19642024-11-21T01:18:11.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19652024-11-21T01:18:11.487ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19662024-11-21T01:18:11.487ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
19672024-11-21T01:18:11.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19682024-11-21T01:18:11.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19692024-11-21T01:18:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19702024-11-21T01:18:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
19712024-11-21T01:18:11.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19722024-11-21T01:18:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19732024-11-21T01:18:11.491ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 190.694857ms iteration = 3 status = 0
19742024-11-21T01:18:11.495ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
19752024-11-21T01:18:11.495ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19762024-11-21T01:18:11.495ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "af20e9a3-592b-4df5-a353-e80ffb7d2bd0", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
19772024-11-21T01:18:11.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19782024-11-21T01:18:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19792024-11-21T01:18:11.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19802024-11-21T01:18:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19812024-11-21T01:18:11.499ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
19822024-11-21T01:18:11.499ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 198.448257ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19832024-11-21T01:18:11.499ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19842024-11-21T01:18:11.499ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19852024-11-21T01:18:11.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19862024-11-21T01:18:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19872024-11-21T01:18:11.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19882024-11-21T01:18:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19892024-11-21T01:18:11.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19902024-11-21T01:18:11.502ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
19912024-11-21T01:18:11.502ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19922024-11-21T01:18:11.502ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
19932024-11-21T01:18:11.502ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 201.659132ms iteration = 2 status = {"generation":2}
19942024-11-21T01:18:11.502ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
19952024-11-21T01:18:11.503ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19962024-11-21T01:18:11.503ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19972024-11-21T01:18:11.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 201.54075ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19982024-11-21T01:18:11.503ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19992024-11-21T01:18:11.503ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20002024-11-21T01:18:11.504ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1c520841-905e-4fab-8c85-93f9b7640163", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
20012024-11-21T01:18:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20022024-11-21T01:18:11.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20032024-11-21T01:18:11.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20042024-11-21T01:18:11.505ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 203.67806ms iteration = 3 status = {}
20052024-11-21T01:18:11.509ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
20062024-11-21T01:18:11.509ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20072024-11-21T01:18:11.509ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
20082024-11-21T01:18:11.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 208.296326ms iteration = 2 status = {"generation":1}
20092024-11-21T01:18:11.509ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
20102024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
20112024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
20122024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
20132024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
20142024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
20152024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
20162024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
20172024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
20182024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
20192024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
20202024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
20212024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
20222024-11-21T01:18:11.528ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
20232024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
20242024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
20252024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
20262024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
20272024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
20282024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
20292024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
20302024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
20312024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
20322024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
20332024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
20342024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
20352024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
20362024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
20372024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
20382024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
20392024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
20402024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
20412024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
20422024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
20432024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
20442024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
20452024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
20462024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
20472024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
20482024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
20492024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
20502024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
20512024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
20522024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
20532024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
20542024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
20552024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
20562024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
20572024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
20582024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
20592024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
20602024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
20612024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
20622024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
20632024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
20642024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
20652024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
20662024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
20672024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
20682024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
20692024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
20702024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
20712024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
20722024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
20732024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
20742024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
20752024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
20762024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
20772024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
20782024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
20792024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
20802024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
20812024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
20822024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
20832024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
20842024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
20852024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
20862024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
20872024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
20882024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
20892024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
20902024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
20912024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
20922024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
20932024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
20942024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
20952024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
20962024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
20972024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
20982024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
20992024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
21002024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
21012024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
21022024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
21032024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
21042024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
21052024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
21062024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
21072024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
21082024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
21092024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
21102024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
21112024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
21122024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
21132024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
21142024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
21152024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
21162024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
21172024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
21182024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
21192024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
21202024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
21212024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
21222024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
21232024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
21242024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
21252024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
21262024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
21272024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
21282024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
21292024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
21302024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
21312024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
21322024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
21332024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
21342024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
21352024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
21362024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
21372024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
21382024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
21392024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
21402024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
21412024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
21422024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
21432024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
21442024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
21452024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
21462024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
21472024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
21482024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
21492024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
21502024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
21512024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
21522024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
21532024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
21542024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
21552024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
21562024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
21572024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
21582024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
21592024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
21602024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
21612024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
21622024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
21632024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
21642024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
21652024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
21662024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
21672024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
21682024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
21692024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
21702024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
21712024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
21722024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
21732024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
21742024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
21752024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
21762024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
21772024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
21782024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
21792024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
21802024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
21812024-11-21T01:18:11.529ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
21822024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
21832024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
21842024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
21852024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
21862024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
21872024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
21882024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
21892024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
21902024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
21912024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
21922024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
21932024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
21942024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
21952024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
21962024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
21972024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
21982024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
21992024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
22002024-11-21T01:18:11.530ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
22012024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
22022024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
22032024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
22042024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
22052024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
22062024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
22072024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
22082024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
22092024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
22102024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
22112024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
22122024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
22132024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
22142024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
22152024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
22162024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
22172024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
22182024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
22192024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
22202024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
22212024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
22222024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
22232024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
22242024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
22252024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
22262024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
22272024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
22282024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
22292024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
22302024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
22312024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
22322024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
22332024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
22342024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
22352024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
22362024-11-21T01:18:11.531ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
22372024-11-21T01:18:11.531ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
22382024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
22392024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
22402024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
22412024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
22422024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
22432024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
22442024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
22452024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
22462024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
22472024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
22482024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
22492024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
22502024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
22512024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
22522024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
22532024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
22542024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
22552024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
22562024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
22572024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
22582024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
22592024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
22602024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
22612024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
22622024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
22632024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
22642024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
22652024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
22662024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
22672024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
22682024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
22692024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
22702024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
22712024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
22722024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
22732024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
22742024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
22752024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
22762024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
22772024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
22782024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
22792024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
22802024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
22812024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
22822024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
22832024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
22842024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
22852024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
22862024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
22872024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
22882024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
22892024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
22902024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
22912024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
22922024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
22932024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
22942024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
22952024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
22962024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
22972024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
22982024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
22992024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23002024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23012024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
23022024-11-21T01:18:11.538ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
23032024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
23042024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
23052024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
23062024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
23072024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
23082024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
23092024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
23102024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
23112024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
23122024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
23132024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
23142024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
23152024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
23162024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
23172024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
23182024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
23192024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
23202024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
23212024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
23222024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
23232024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
23242024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
23252024-11-21T01:18:11.539ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
23262024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
23272024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
23282024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
23292024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
23302024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
23312024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
23322024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
23332024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
23342024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
23352024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
23362024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
23372024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
23382024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
23392024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
23402024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
23412024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
23422024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
23432024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
23442024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
23452024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
23462024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
23472024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
23482024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
23492024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
23502024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
23512024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
23522024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
23532024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
23542024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
23552024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
23562024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
23572024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
23582024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
23592024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
23602024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
23612024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
23622024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
23632024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
23642024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
23652024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
23662024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
23672024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
23682024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
23692024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
23702024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
23712024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
23722024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
23732024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
23742024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
23752024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
23762024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
23772024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
23782024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
23792024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
23802024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23812024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23822024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
23832024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
23842024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
23852024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
23862024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
23872024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
23882024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
23892024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
23902024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
23912024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
23922024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
23932024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
23942024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
23952024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
23962024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
23972024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
23982024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
23992024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
24002024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
24012024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
24022024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
24032024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
24042024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
24052024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
24062024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
24072024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
24082024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
24092024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
24102024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
24112024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
24122024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
24132024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
24142024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
24152024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
24162024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
24172024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
24182024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
24192024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
24202024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
24212024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
24222024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
24232024-11-21T01:18:11.540ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
24242024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
24252024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
24262024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
24272024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
24282024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
24292024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
24302024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
24312024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
24322024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
24332024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
24342024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
24352024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
24362024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
24372024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
24382024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
24392024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
24402024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
24412024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
24422024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
24432024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
24442024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
24452024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
24462024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
24472024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
24482024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
24492024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
24502024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
24512024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
24522024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
24532024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
24542024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
24552024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
24562024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
24572024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
24582024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
24592024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
24602024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
24612024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
24622024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
24632024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
24642024-11-21T01:18:11.541ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
24652024-11-21T01:18:11.541ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
24662024-11-21T01:18:11.545ZDEBGnexus (nexus-producer-server): registered DTrace probes
24672024-11-21T01:18:11.548ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:37039 method = GET path = /{producer_id} versions = all
24682024-11-21T01:18:11.548ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:37039
24692024-11-21T01:18:11.548ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:37039
24702024-11-21T01:18:11.548ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:37039
24712024-11-21T01:18:11.548ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
24722024-11-21T01:18:11.548ZDEBGnexus (nexus-producer-server): starting producer registration task
24732024-11-21T01:18:11.549ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:37039 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
24742024-11-21T01:18:11.549ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24752024-11-21T01:18:11.549ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
24762024-11-21T01:18:11.595ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24772024-11-21T01:18:11.636ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24782024-11-21T01:18:11.676ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24792024-11-21T01:18:11.677ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "84f5e55c-0b47-4cdb-abdd-465fa8c994b1", "content-length": "691", "date": "Thu, 21 Nov 2024 01:18:10 GMT"} })
24802024-11-21T01:18:11.677ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
24812024-11-21T01:18:11.677ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
24822024-11-21T01:18:11.677ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
24832024-11-21T01:18:11.678ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 377.661822ms iteration = 3 status = {}
24842024-11-21T01:18:11.682ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
24852024-11-21T01:18:11.682ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:41455
24862024-11-21T01:18:11.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41455 req_id = 9a0f00fc-0cdc-45da-9594-e884661827b5 roles = RoleSet { roles: {} } uri = /metrics/producers
24872024-11-21T01:18:11.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41455 req_id = 9a0f00fc-0cdc-45da-9594-e884661827b5 resource = Database result = Ok(()) uri = /metrics/producers
24882024-11-21T01:18:11.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ece6c227-c56f-419d-b4b5-bddf3f0352e7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
24892024-11-21T01:18:11.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ece6c227-c56f-419d-b4b5-bddf3f0352e7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
24902024-11-21T01:18:11.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ece6c227-c56f-419d-b4b5-bddf3f0352e7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
24912024-11-21T01:18:11.708ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24922024-11-21T01:18:11.708ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "54851a4d-deee-41bf-aadd-4c61f2c0cac1", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24932024-11-21T01:18:11.708ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24942024-11-21T01:18:11.709ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0fce2221-8d85-434d-b2fa-44ce275511da", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24952024-11-21T01:18:11.709ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24962024-11-21T01:18:11.710ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
24972024-11-21T01:18:11.710ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 208.109622ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24982024-11-21T01:18:11.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24992024-11-21T01:18:11.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25002024-11-21T01:18:11.733ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25012024-11-21T01:18:11.734ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
25022024-11-21T01:18:11.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25032024-11-21T01:18:11.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25042024-11-21T01:18:11.735ZINFOnexus: assigned collector to new producer collector_id = 49435a09-4a28-49d2-bf6d-81a21cb92fe2 file = nexus/src/app/oximeter.rs:76 producer_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
25052024-11-21T01:18:11.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53134 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41455 req_id = 9a0f00fc-0cdc-45da-9594-e884661827b5 response_code = 201 uri = /metrics/producers
25062024-11-21T01:18:11.735ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9a0f00fc-0cdc-45da-9594-e884661827b5", "content-length": "41", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
25072024-11-21T01:18:11.736ZDEBGnexus (producer-registration-task): registered with nexus successfully
25082024-11-21T01:18:11.736ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
25092024-11-21T01:18:11.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25102024-11-21T01:18:11.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3da08f7-b965-4de6-8ef0-a765ac30b42a", "content-length": "134", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
25112024-11-21T01:18:11.743ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25122024-11-21T01:18:11.743ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
25132024-11-21T01:18:11.743ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25142024-11-21T01:18:11.743ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25152024-11-21T01:18:11.743ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25162024-11-21T01:18:11.743ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25172024-11-21T01:18:11.743ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25182024-11-21T01:18:11.743ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25192024-11-21T01:18:11.744ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25202024-11-21T01:18:11.744ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25212024-11-21T01:18:11.744ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
25222024-11-21T01:18:11.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25232024-11-21T01:18:11.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25242024-11-21T01:18:11.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25252024-11-21T01:18:11.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bceb9f78-9087-46fe-a69f-da473f1cce61", "content-length": "2", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
25262024-11-21T01:18:11.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25272024-11-21T01:18:11.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2fc7a19-ff25-4832-a196-904381aa9eff", "content-length": "51", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
25282024-11-21T01:18:11.747ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
25292024-11-21T01:18:11.747ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25302024-11-21T01:18:11.765ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25312024-11-21T01:18:11.765ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a244a5c4-5f07-4352-b01c-fc51260e948f", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25322024-11-21T01:18:11.765ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25332024-11-21T01:18:11.766ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "232ad7be-03ae-4c8e-8b66-d635ee59b9e2", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25342024-11-21T01:18:11.766ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25352024-11-21T01:18:11.767ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1c768ace-3823-4b77-99ca-88b6f640ec86", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25362024-11-21T01:18:11.767ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25372024-11-21T01:18:11.768ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
25382024-11-21T01:18:11.768ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 259.514757ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25392024-11-21T01:18:11.840ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e01df4e8-d951-4992-9ec8-8e157c56eb62", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
25402024-11-21T01:18:11.840ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
25412024-11-21T01:18:11.840ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25422024-11-21T01:18:11.841ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7461e1a8-cd9c-454d-a6fb-6c3441fdb2a7", "content-length": "682", "date": "Thu, 21 Nov 2024 01:18:11 GMT"} })
25432024-11-21T01:18:11.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25442024-11-21T01:18:11.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25452024-11-21T01:18:11.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25462024-11-21T01:18:11.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25472024-11-21T01:18:11.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25482024-11-21T01:18:11.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25492024-11-21T01:18:11.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25502024-11-21T01:18:11.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25512024-11-21T01:18:11.956ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 655.569398ms iteration = 3 status = {}
25522024-11-21T01:18:12.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12c4b5a3-cfd4-461c-9868-d4f84b3fc8fd roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25532024-11-21T01:18:12.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12c4b5a3-cfd4-461c-9868-d4f84b3fc8fd resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25542024-11-21T01:18:12.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12c4b5a3-cfd4-461c-9868-d4f84b3fc8fd response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25552024-11-21T01:18:13.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 34478aa3-aa11-4771-8ff6-e77100140569 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25562024-11-21T01:18:13.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 34478aa3-aa11-4771-8ff6-e77100140569 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25572024-11-21T01:18:13.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 34478aa3-aa11-4771-8ff6-e77100140569 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25582024-11-21T01:18:14.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4d70df23-2b01-47d9-b588-bec9e40cdb2f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25592024-11-21T01:18:14.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4d70df23-2b01-47d9-b588-bec9e40cdb2f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25602024-11-21T01:18:14.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4d70df23-2b01-47d9-b588-bec9e40cdb2f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25612024-11-21T01:18:15.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4db51cde-4c87-4672-91e2-f06fe959b932 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25622024-11-21T01:18:15.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4db51cde-4c87-4672-91e2-f06fe959b932 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25632024-11-21T01:18:15.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4db51cde-4c87-4672-91e2-f06fe959b932 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25642024-11-21T01:18:16.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 205e29ac-48ad-4619-b533-5c5ee0f13646 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25652024-11-21T01:18:16.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 205e29ac-48ad-4619-b533-5c5ee0f13646 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25662024-11-21T01:18:16.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 205e29ac-48ad-4619-b533-5c5ee0f13646 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25672024-11-21T01:18:17.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a64a97fe-73ed-4328-9766-ea3604ca5bc0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25682024-11-21T01:18:17.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a64a97fe-73ed-4328-9766-ea3604ca5bc0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25692024-11-21T01:18:17.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a64a97fe-73ed-4328-9766-ea3604ca5bc0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25702024-11-21T01:18:18.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 65c45e46-568a-412d-a285-bdda07d191a0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25712024-11-21T01:18:18.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 65c45e46-568a-412d-a285-bdda07d191a0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25722024-11-21T01:18:18.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 65c45e46-568a-412d-a285-bdda07d191a0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25732024-11-21T01:18:19.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f80f9fea-de45-470e-a731-edbe11fe8eec roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25742024-11-21T01:18:19.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f80f9fea-de45-470e-a731-edbe11fe8eec resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25752024-11-21T01:18:19.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f80f9fea-de45-470e-a731-edbe11fe8eec response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25762024-11-21T01:18:20.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5403606-9e69-4d20-a244-7b779d74a645 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25772024-11-21T01:18:20.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5403606-9e69-4d20-a244-7b779d74a645 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25782024-11-21T01:18:20.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5403606-9e69-4d20-a244-7b779d74a645 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
25792024-11-21T01:18:21.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
25802024-11-21T01:18:21.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25812024-11-21T01:18:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25822024-11-21T01:18:21.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
25832024-11-21T01:18:21.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25842024-11-21T01:18:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25852024-11-21T01:18:21.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25862024-11-21T01:18:21.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25872024-11-21T01:18:21.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25882024-11-21T01:18:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25892024-11-21T01:18:21.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25902024-11-21T01:18:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25912024-11-21T01:18:21.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922024-11-21T01:18:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
25932024-11-21T01:18:21.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25942024-11-21T01:18:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25952024-11-21T01:18:21.323ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
25962024-11-21T01:18:21.323ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.823152ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
25972024-11-21T01:18:21.330ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25982024-11-21T01:18:21.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25992024-11-21T01:18:21.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.200073ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26002024-11-21T01:18:21.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e47e2067-8bfe-4dc2-aa2f-d644ab7f9225 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26012024-11-21T01:18:21.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e47e2067-8bfe-4dc2-aa2f-d644ab7f9225 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26022024-11-21T01:18:21.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e47e2067-8bfe-4dc2-aa2f-d644ab7f9225 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26032024-11-21T01:18:22.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ee25f875-b138-41c6-99d1-dd0f711ac37e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26042024-11-21T01:18:22.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ee25f875-b138-41c6-99d1-dd0f711ac37e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26052024-11-21T01:18:22.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ee25f875-b138-41c6-99d1-dd0f711ac37e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26062024-11-21T01:18:23.559ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:37039 remote_addr = [fd00:1122:3344:101::d]:35787
26072024-11-21T01:18:23.567ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7861 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = e48fbf6a-5f77-4b11-903e-b10ee2083b4b response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
26082024-11-21T01:18:23.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbad01c5-9889-4c69-ad1f-d2556fa18692 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26092024-11-21T01:18:23.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbad01c5-9889-4c69-ad1f-d2556fa18692 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26102024-11-21T01:18:23.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbad01c5-9889-4c69-ad1f-d2556fa18692 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26112024-11-21T01:18:24.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 619293e4-aeaf-4952-a2cb-0d7afa6aaafe roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26122024-11-21T01:18:24.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 619293e4-aeaf-4952-a2cb-0d7afa6aaafe resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26132024-11-21T01:18:24.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 619293e4-aeaf-4952-a2cb-0d7afa6aaafe response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26142024-11-21T01:18:25.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07b19cea-bc94-4f01-985b-c583aabe973a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26152024-11-21T01:18:25.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07b19cea-bc94-4f01-985b-c583aabe973a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26162024-11-21T01:18:25.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07b19cea-bc94-4f01-985b-c583aabe973a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26172024-11-21T01:18:27.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bc624137-b61a-4fbc-a83f-267d1b7e8124 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26182024-11-21T01:18:27.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bc624137-b61a-4fbc-a83f-267d1b7e8124 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26192024-11-21T01:18:27.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bc624137-b61a-4fbc-a83f-267d1b7e8124 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26202024-11-21T01:18:28.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6156391-2cda-49af-9dc7-de3e36fd0129 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26212024-11-21T01:18:28.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6156391-2cda-49af-9dc7-de3e36fd0129 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26222024-11-21T01:18:28.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6156391-2cda-49af-9dc7-de3e36fd0129 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26232024-11-21T01:18:29.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e3935338-178a-4943-8c80-bcfbe7529a50 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26242024-11-21T01:18:29.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e3935338-178a-4943-8c80-bcfbe7529a50 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26252024-11-21T01:18:29.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e3935338-178a-4943-8c80-bcfbe7529a50 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26262024-11-21T01:18:30.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed139d74-f53d-4909-bc80-956ef10fd940 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26272024-11-21T01:18:30.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed139d74-f53d-4909-bc80-956ef10fd940 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26282024-11-21T01:18:30.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed139d74-f53d-4909-bc80-956ef10fd940 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26292024-11-21T01:18:31.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 077fc6e2-af1d-4d8b-826f-c1b94c6c9581 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26302024-11-21T01:18:31.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 077fc6e2-af1d-4d8b-826f-c1b94c6c9581 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26312024-11-21T01:18:31.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 077fc6e2-af1d-4d8b-826f-c1b94c6c9581 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26322024-11-21T01:18:31.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
26332024-11-21T01:18:31.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26342024-11-21T01:18:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26352024-11-21T01:18:31.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
26362024-11-21T01:18:31.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26372024-11-21T01:18:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26382024-11-21T01:18:31.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26392024-11-21T01:18:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26402024-11-21T01:18:31.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.745337ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26412024-11-21T01:18:31.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26422024-11-21T01:18:31.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26432024-11-21T01:18:31.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26442024-11-21T01:18:31.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26452024-11-21T01:18:31.333ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26462024-11-21T01:18:31.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26472024-11-21T01:18:31.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26482024-11-21T01:18:31.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
26492024-11-21T01:18:31.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26502024-11-21T01:18:31.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26512024-11-21T01:18:31.348ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
26522024-11-21T01:18:31.348ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.625167ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
26532024-11-21T01:18:32.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 106a325e-c8ab-4dd6-bda4-e55c7043125e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26542024-11-21T01:18:32.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 106a325e-c8ab-4dd6-bda4-e55c7043125e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26552024-11-21T01:18:32.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 106a325e-c8ab-4dd6-bda4-e55c7043125e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26562024-11-21T01:18:33.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3223d021-183b-4c1e-9511-fcfb6608d843 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26572024-11-21T01:18:33.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3223d021-183b-4c1e-9511-fcfb6608d843 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26582024-11-21T01:18:33.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3223d021-183b-4c1e-9511-fcfb6608d843 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26592024-11-21T01:18:33.559ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 243f6508-e94d-45a9-b848-4628e86813d0 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
26602024-11-21T01:18:34.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8cc9882b-61a8-4538-859f-04c62645dd28 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26612024-11-21T01:18:34.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8cc9882b-61a8-4538-859f-04c62645dd28 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26622024-11-21T01:18:34.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8cc9882b-61a8-4538-859f-04c62645dd28 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26632024-11-21T01:18:35.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2a7dc6d8-5343-4cc2-b526-7f902d5f4f07 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26642024-11-21T01:18:35.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2a7dc6d8-5343-4cc2-b526-7f902d5f4f07 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26652024-11-21T01:18:35.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2a7dc6d8-5343-4cc2-b526-7f902d5f4f07 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26662024-11-21T01:18:36.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19ff1737-80b4-454f-8a79-c94f2f255bfa roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26672024-11-21T01:18:36.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19ff1737-80b4-454f-8a79-c94f2f255bfa resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26682024-11-21T01:18:36.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19ff1737-80b4-454f-8a79-c94f2f255bfa response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26692024-11-21T01:18:37.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb05ad9e-859a-474d-97bf-05a5ca6bde24 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26702024-11-21T01:18:37.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb05ad9e-859a-474d-97bf-05a5ca6bde24 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26712024-11-21T01:18:37.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb05ad9e-859a-474d-97bf-05a5ca6bde24 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26722024-11-21T01:18:38.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 56d9a9ea-8dfc-463e-8c51-f81f806788b4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26732024-11-21T01:18:38.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 56d9a9ea-8dfc-463e-8c51-f81f806788b4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26742024-11-21T01:18:38.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 56d9a9ea-8dfc-463e-8c51-f81f806788b4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26752024-11-21T01:18:39.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 88de84a9-87ce-4036-91ef-f29a8e207af6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26762024-11-21T01:18:39.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 88de84a9-87ce-4036-91ef-f29a8e207af6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26772024-11-21T01:18:39.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 88de84a9-87ce-4036-91ef-f29a8e207af6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26782024-11-21T01:18:40.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d7127025-3311-4eb4-acf9-1b4a30fd81ed roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26792024-11-21T01:18:40.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d7127025-3311-4eb4-acf9-1b4a30fd81ed resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26802024-11-21T01:18:40.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d7127025-3311-4eb4-acf9-1b4a30fd81ed response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
26812024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
26822024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
26832024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26842024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26852024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
26862024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
26872024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26882024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26892024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
26902024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26912024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
26922024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26932024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
26942024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
26952024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26962024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
26972024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26982024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26992024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27002024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27012024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27022024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27032024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27042024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27052024-11-21T01:18:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27062024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
27072024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27082024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
27092024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27102024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27112024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
27122024-11-21T01:18:41.302ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27132024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
27142024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27152024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27162024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27172024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27182024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27192024-11-21T01:18:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27202024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
27212024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
27222024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27232024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27242024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
27252024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27262024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
27272024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27282024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27292024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27312024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27322024-11-21T01:18:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27332024-11-21T01:18:41.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27342024-11-21T01:18:41.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27352024-11-21T01:18:41.305ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.680002ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27362024-11-21T01:18:41.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27372024-11-21T01:18:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27382024-11-21T01:18:41.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27392024-11-21T01:18:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27402024-11-21T01:18:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27412024-11-21T01:18:41.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27422024-11-21T01:18:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27432024-11-21T01:18:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27442024-11-21T01:18:41.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27452024-11-21T01:18:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27462024-11-21T01:18:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27472024-11-21T01:18:41.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27482024-11-21T01:18:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27492024-11-21T01:18:41.310ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 209656968 } })
27502024-11-21T01:18:41.310ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
27512024-11-21T01:18:41.310ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 210335668 } })
27522024-11-21T01:18:41.311ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
27532024-11-21T01:18:41.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27542024-11-21T01:18:41.311ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27552024-11-21T01:18:41.311ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27562024-11-21T01:18:41.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27572024-11-21T01:18:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27582024-11-21T01:18:41.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27592024-11-21T01:18:41.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.619702ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
27602024-11-21T01:18:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27612024-11-21T01:18:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27622024-11-21T01:18:41.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27632024-11-21T01:18:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27642024-11-21T01:18:41.316ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27652024-11-21T01:18:41.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27662024-11-21T01:18:41.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1100, tv_nsec: 216297902 } })
27672024-11-21T01:18:41.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27682024-11-21T01:18:41.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
27692024-11-21T01:18:41.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27702024-11-21T01:18:41.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = acbf7d74-9931-466d-baca-f506e5bf6614 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
27712024-11-21T01:18:41.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = acbf7d74-9931-466d-baca-f506e5bf6614 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
27722024-11-21T01:18:41.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27732024-11-21T01:18:41.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27742024-11-21T01:18:41.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = acbf7d74-9931-466d-baca-f506e5bf6614 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
27752024-11-21T01:18:41.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27762024-11-21T01:18:41.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27772024-11-21T01:18:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27782024-11-21T01:18:41.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 6a943132-0c6d-489e-b2f2-82314c72ba4c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27792024-11-21T01:18:41.354ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27802024-11-21T01:18:41.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 6a943132-0c6d-489e-b2f2-82314c72ba4c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27812024-11-21T01:18:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27822024-11-21T01:18:41.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27832024-11-21T01:18:41.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27842024-11-21T01:18:41.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27852024-11-21T01:18:41.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27862024-11-21T01:18:41.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 6a943132-0c6d-489e-b2f2-82314c72ba4c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27872024-11-21T01:18:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27882024-11-21T01:18:41.358ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27892024-11-21T01:18:41.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.559013ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
27902024-11-21T01:18:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27912024-11-21T01:18:41.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27922024-11-21T01:18:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27932024-11-21T01:18:41.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27942024-11-21T01:18:41.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.338595ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27952024-11-21T01:18:41.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
27962024-11-21T01:18:41.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27972024-11-21T01:18:41.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27982024-11-21T01:18:41.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27992024-11-21T01:18:41.368ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.299879ms iteration = 4 status = 0
28002024-11-21T01:18:41.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28012024-11-21T01:18:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28022024-11-21T01:18:41.369ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28032024-11-21T01:18:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28042024-11-21T01:18:41.369ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28052024-11-21T01:18:41.369ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28062024-11-21T01:18:41.369ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28072024-11-21T01:18:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28082024-11-21T01:18:41.372ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28092024-11-21T01:18:41.372ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.722733ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28102024-11-21T01:18:41.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
28112024-11-21T01:18:41.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28122024-11-21T01:18:41.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28132024-11-21T01:18:41.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28142024-11-21T01:18:41.384ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
28152024-11-21T01:18:41.384ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28162024-11-21T01:18:41.385ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2f22d31-3581-47a8-be43-ae909b676d78", "content-length": "26", "date": "Thu, 21 Nov 2024 01:18:40 GMT"} })
28172024-11-21T01:18:41.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28182024-11-21T01:18:41.385ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
28192024-11-21T01:18:41.385ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.524051ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
28202024-11-21T01:18:41.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28212024-11-21T01:18:41.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28222024-11-21T01:18:41.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28232024-11-21T01:18:41.387ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28242024-11-21T01:18:41.390ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.917135ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
28252024-11-21T01:18:41.396ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28262024-11-21T01:18:41.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.230253ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28272024-11-21T01:18:41.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28282024-11-21T01:18:41.399ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
28292024-11-21T01:18:41.399ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28302024-11-21T01:18:41.399ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ca55732-926e-4e32-a1b0-756e1633a4ad", "content-length": "26", "date": "Thu, 21 Nov 2024 01:18:40 GMT"} })
28312024-11-21T01:18:41.399ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28322024-11-21T01:18:41.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
28332024-11-21T01:18:41.409ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
28342024-11-21T01:18:41.409ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28352024-11-21T01:18:41.410ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72e278af-0f91-4c9e-b538-4c148988a10d", "content-length": "26", "date": "Thu, 21 Nov 2024 01:18:41 GMT"} })
28362024-11-21T01:18:41.410ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28372024-11-21T01:18:41.410ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28382024-11-21T01:18:41.410ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28392024-11-21T01:18:41.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.215305ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28402024-11-21T01:18:41.411ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28412024-11-21T01:18:41.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28422024-11-21T01:18:41.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28432024-11-21T01:18:41.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.429587ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
28442024-11-21T01:18:41.465ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28452024-11-21T01:18:41.465ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "db854d5c-5ccf-4c8a-8de8-1c9ef6973e5b", "content-length": "1", "date": "Thu, 21 Nov 2024 01:18:40 GMT"} })
28462024-11-21T01:18:41.466ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28472024-11-21T01:18:41.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28482024-11-21T01:18:41.469ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 168.13527ms iteration = 4 status = null
28492024-11-21T01:18:41.480ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.664311ms iteration = 6 status = {"physical_disks_added":0}
28502024-11-21T01:18:41.490ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 189.46ms iteration = 4 status = {}
28512024-11-21T01:18:41.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28522024-11-21T01:18:41.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28532024-11-21T01:18:41.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542024-11-21T01:18:41.513ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28552024-11-21T01:18:41.513ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28562024-11-21T01:18:41.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28572024-11-21T01:18:41.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28582024-11-21T01:18:41.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28592024-11-21T01:18:41.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28602024-11-21T01:18:41.541ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "580a8244-cf04-4777-bc64-0e02af2e075d", "content-length": "372", "date": "Thu, 21 Nov 2024 01:18:40 GMT"} })
28612024-11-21T01:18:41.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28622024-11-21T01:18:41.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28632024-11-21T01:18:41.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28642024-11-21T01:18:41.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28652024-11-21T01:18:41.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28662024-11-21T01:18:41.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28672024-11-21T01:18:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28682024-11-21T01:18:41.555ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
28692024-11-21T01:18:41.555ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28702024-11-21T01:18:41.556ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
28712024-11-21T01:18:41.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28722024-11-21T01:18:41.556ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f834f713-e5f0-4e17-a581-cd7f61827c71", "date": "Thu, 21 Nov 2024 01:18:41 GMT"} })
28732024-11-21T01:18:41.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28742024-11-21T01:18:41.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28752024-11-21T01:18:41.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28762024-11-21T01:18:41.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28772024-11-21T01:18:41.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28782024-11-21T01:18:41.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28792024-11-21T01:18:41.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28802024-11-21T01:18:41.564ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
28812024-11-21T01:18:41.565ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "224e9ed3-c3fb-4c17-86e2-ef802fb2d2ab", "content-length": "134", "date": "Thu, 21 Nov 2024 01:18:40 GMT"} })
28822024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
28832024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
28842024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
28852024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
28862024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28872024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28882024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28892024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28902024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28912024-11-21T01:18:41.565ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28922024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
28932024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
28942024-11-21T01:18:41.565ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
28952024-11-21T01:18:41.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28962024-11-21T01:18:41.566ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ea4ecabb-825a-4e1b-927e-d823d775849a", "date": "Thu, 21 Nov 2024 01:18:41 GMT"} })
28972024-11-21T01:18:41.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28982024-11-21T01:18:41.567ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 265.114256ms iteration = 4 status = {}
28992024-11-21T01:18:41.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29002024-11-21T01:18:41.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a72f2fe-5b51-4cf7-b3d2-626d2f6de926", "content-length": "2", "date": "Thu, 21 Nov 2024 01:18:40 GMT"} })
29012024-11-21T01:18:41.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29022024-11-21T01:18:41.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0deff36f-8c3b-486a-9cbc-e7ea90a5d6cc", "content-length": "51", "date": "Thu, 21 Nov 2024 01:18:40 GMT"} })
29032024-11-21T01:18:41.568ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
29042024-11-21T01:18:41.568ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29052024-11-21T01:18:41.630ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29062024-11-21T01:18:41.665ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "41b22c86-1aef-46f5-9065-0a493bb26b0d", "date": "Thu, 21 Nov 2024 01:18:41 GMT"} })
29072024-11-21T01:18:41.665ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
29082024-11-21T01:18:41.665ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29092024-11-21T01:18:41.666ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb9f81b3-e068-4796-b80b-6bc824558705", "content-length": "691", "date": "Thu, 21 Nov 2024 01:18:41 GMT"} })
29102024-11-21T01:18:41.666ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29112024-11-21T01:18:41.666ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29122024-11-21T01:18:41.666ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29132024-11-21T01:18:41.666ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e99a0397-617e-441d-a035-20ff875fe587", "content-length": "682", "date": "Thu, 21 Nov 2024 01:18:41 GMT"} })
29142024-11-21T01:18:41.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29152024-11-21T01:18:41.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29162024-11-21T01:18:41.667ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 366.682717ms iteration = 4 status = {}
29172024-11-21T01:18:41.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29182024-11-21T01:18:41.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29192024-11-21T01:18:41.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29202024-11-21T01:18:41.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29212024-11-21T01:18:41.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29222024-11-21T01:18:41.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29232024-11-21T01:18:41.701ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 400.183479ms iteration = 4 status = {}
29242024-11-21T01:18:42.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e9504d8d-0ad4-4c9d-8948-b27204593876 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29252024-11-21T01:18:42.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e9504d8d-0ad4-4c9d-8948-b27204593876 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29262024-11-21T01:18:42.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e9504d8d-0ad4-4c9d-8948-b27204593876 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29272024-11-21T01:18:43.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93404f2b-086d-4e26-8f86-0dcb224a3cd9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29282024-11-21T01:18:43.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93404f2b-086d-4e26-8f86-0dcb224a3cd9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29292024-11-21T01:18:43.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93404f2b-086d-4e26-8f86-0dcb224a3cd9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29302024-11-21T01:18:44.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 06aa57dd-8627-4ca1-a566-0596aaca2ed0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29312024-11-21T01:18:44.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 06aa57dd-8627-4ca1-a566-0596aaca2ed0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29322024-11-21T01:18:44.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 06aa57dd-8627-4ca1-a566-0596aaca2ed0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29332024-11-21T01:18:45.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2c012569-a0d1-43e6-8228-927ebd76133f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29342024-11-21T01:18:45.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2c012569-a0d1-43e6-8228-927ebd76133f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29352024-11-21T01:18:45.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2c012569-a0d1-43e6-8228-927ebd76133f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29362024-11-21T01:18:46.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ac9c997-1f12-466f-b9e0-405096850f0e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29372024-11-21T01:18:46.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ac9c997-1f12-466f-b9e0-405096850f0e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29382024-11-21T01:18:46.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ac9c997-1f12-466f-b9e0-405096850f0e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29392024-11-21T01:18:47.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4416cf01-498e-48e9-af6b-95ffdae486f0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29402024-11-21T01:18:47.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4416cf01-498e-48e9-af6b-95ffdae486f0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29412024-11-21T01:18:47.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4416cf01-498e-48e9-af6b-95ffdae486f0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29422024-11-21T01:18:48.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a7dfb6f9-4ce7-4c4f-8362-c4cfa73e9b34 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29432024-11-21T01:18:48.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a7dfb6f9-4ce7-4c4f-8362-c4cfa73e9b34 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29442024-11-21T01:18:48.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a7dfb6f9-4ce7-4c4f-8362-c4cfa73e9b34 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29452024-11-21T01:18:48.486ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 856 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 0776ce5e-247a-4976-8997-c69fdb3adf8f response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
29462024-11-21T01:18:49.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 059ef214-3e5f-4436-94d7-28318977c963 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29472024-11-21T01:18:49.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 059ef214-3e5f-4436-94d7-28318977c963 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29482024-11-21T01:18:49.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 059ef214-3e5f-4436-94d7-28318977c963 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29492024-11-21T01:18:50.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f96442b1-16bb-42ff-b0a9-2a6a2f13f5ab roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29502024-11-21T01:18:50.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f96442b1-16bb-42ff-b0a9-2a6a2f13f5ab resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29512024-11-21T01:18:50.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f96442b1-16bb-42ff-b0a9-2a6a2f13f5ab response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29522024-11-21T01:18:51.300ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
29532024-11-21T01:18:51.300ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29542024-11-21T01:18:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29552024-11-21T01:18:51.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
29562024-11-21T01:18:51.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29572024-11-21T01:18:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29582024-11-21T01:18:51.329ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29592024-11-21T01:18:51.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29602024-11-21T01:18:51.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29612024-11-21T01:18:51.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29622024-11-21T01:18:51.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29632024-11-21T01:18:51.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29642024-11-21T01:18:51.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29652024-11-21T01:18:51.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29662024-11-21T01:18:51.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.247556ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29672024-11-21T01:18:51.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29682024-11-21T01:18:51.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
29692024-11-21T01:18:51.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29702024-11-21T01:18:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29712024-11-21T01:18:51.383ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
29722024-11-21T01:18:51.383ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.906928ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
29732024-11-21T01:18:51.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 59219153-dbf3-48fe-b239-8484d74a2158 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29742024-11-21T01:18:51.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 59219153-dbf3-48fe-b239-8484d74a2158 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29752024-11-21T01:18:51.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 59219153-dbf3-48fe-b239-8484d74a2158 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29762024-11-21T01:18:52.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 35e61407-511b-4fba-a55b-2ce05688247b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29772024-11-21T01:18:52.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 35e61407-511b-4fba-a55b-2ce05688247b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29782024-11-21T01:18:52.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 35e61407-511b-4fba-a55b-2ce05688247b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29792024-11-21T01:18:53.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8785d8df-51a0-4898-ad08-4c35f67cd61c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29802024-11-21T01:18:53.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8785d8df-51a0-4898-ad08-4c35f67cd61c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29812024-11-21T01:18:53.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8785d8df-51a0-4898-ad08-4c35f67cd61c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29822024-11-21T01:18:54.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0c34e6de-a5dc-4026-8d57-e5bff68b7982 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29832024-11-21T01:18:54.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0c34e6de-a5dc-4026-8d57-e5bff68b7982 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29842024-11-21T01:18:54.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0c34e6de-a5dc-4026-8d57-e5bff68b7982 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29852024-11-21T01:18:55.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd9d8071-35a0-476a-bcf5-87e79a423501 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29862024-11-21T01:18:55.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd9d8071-35a0-476a-bcf5-87e79a423501 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29872024-11-21T01:18:55.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd9d8071-35a0-476a-bcf5-87e79a423501 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29882024-11-21T01:18:56.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ebd5be0d-20db-4c19-97e8-9960dbaafb76 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29892024-11-21T01:18:56.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ebd5be0d-20db-4c19-97e8-9960dbaafb76 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29902024-11-21T01:18:56.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ebd5be0d-20db-4c19-97e8-9960dbaafb76 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29912024-11-21T01:18:57.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12564f80-63da-451d-b418-3cb6e6ffa326 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29922024-11-21T01:18:57.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12564f80-63da-451d-b418-3cb6e6ffa326 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29932024-11-21T01:18:57.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 12564f80-63da-451d-b418-3cb6e6ffa326 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29942024-11-21T01:18:58.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3d69a0c2-8986-4508-a8f0-2cd39a40e8ce roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29952024-11-21T01:18:58.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3d69a0c2-8986-4508-a8f0-2cd39a40e8ce resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29962024-11-21T01:18:58.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3d69a0c2-8986-4508-a8f0-2cd39a40e8ce response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29972024-11-21T01:18:59.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 200bb773-d4d7-4982-9788-e6bd3a57bde2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29982024-11-21T01:18:59.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 200bb773-d4d7-4982-9788-e6bd3a57bde2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
29992024-11-21T01:18:59.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 200bb773-d4d7-4982-9788-e6bd3a57bde2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30002024-11-21T01:19:00.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36b13e31-69e7-4a35-a57b-6d9565fa26aa roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30012024-11-21T01:19:00.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36b13e31-69e7-4a35-a57b-6d9565fa26aa resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30022024-11-21T01:19:00.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36b13e31-69e7-4a35-a57b-6d9565fa26aa response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30032024-11-21T01:19:01.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
30042024-11-21T01:19:01.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30052024-11-21T01:19:01.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30062024-11-21T01:19:01.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
30072024-11-21T01:19:01.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30082024-11-21T01:19:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30092024-11-21T01:19:01.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30102024-11-21T01:19:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30112024-11-21T01:19:01.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30122024-11-21T01:19:01.332ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30132024-11-21T01:19:01.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30142024-11-21T01:19:01.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30152024-11-21T01:19:01.332ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.685103ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30162024-11-21T01:19:01.334ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30172024-11-21T01:19:01.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30182024-11-21T01:19:01.336ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30192024-11-21T01:19:01.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
30202024-11-21T01:19:01.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30212024-11-21T01:19:01.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30222024-11-21T01:19:01.348ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
30232024-11-21T01:19:01.348ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.661367ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
30242024-11-21T01:19:01.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9ff37f5b-2b56-4b44-9175-d678f120194b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30252024-11-21T01:19:01.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9ff37f5b-2b56-4b44-9175-d678f120194b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30262024-11-21T01:19:02.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9ff37f5b-2b56-4b44-9175-d678f120194b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30272024-11-21T01:19:03.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 277c6e34-cbec-4504-a2b3-7ae5f9b2cc22 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30282024-11-21T01:19:03.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 277c6e34-cbec-4504-a2b3-7ae5f9b2cc22 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30292024-11-21T01:19:03.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 277c6e34-cbec-4504-a2b3-7ae5f9b2cc22 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30302024-11-21T01:19:03.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 566 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 80884115-2121-40c2-9ad6-ee216636f8e2 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
30312024-11-21T01:19:04.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52f53c62-db2c-4f1f-891e-24f8df011e87 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30322024-11-21T01:19:04.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52f53c62-db2c-4f1f-891e-24f8df011e87 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30332024-11-21T01:19:04.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52f53c62-db2c-4f1f-891e-24f8df011e87 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30342024-11-21T01:19:05.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a6efc0a-68a3-41de-a38e-4d92c0ddbd34 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30352024-11-21T01:19:05.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a6efc0a-68a3-41de-a38e-4d92c0ddbd34 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30362024-11-21T01:19:05.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a6efc0a-68a3-41de-a38e-4d92c0ddbd34 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30372024-11-21T01:19:06.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42f6c6e8-4539-4fd3-99d5-50f4ab032d4b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30382024-11-21T01:19:06.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42f6c6e8-4539-4fd3-99d5-50f4ab032d4b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30392024-11-21T01:19:06.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42f6c6e8-4539-4fd3-99d5-50f4ab032d4b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30402024-11-21T01:19:07.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = efcf91fd-3be3-4a07-9374-4d9df5dee677 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30412024-11-21T01:19:07.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = efcf91fd-3be3-4a07-9374-4d9df5dee677 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30422024-11-21T01:19:07.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = efcf91fd-3be3-4a07-9374-4d9df5dee677 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30432024-11-21T01:19:08.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ed98c76-b181-4159-b065-7903e3bf9596 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30442024-11-21T01:19:08.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ed98c76-b181-4159-b065-7903e3bf9596 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30452024-11-21T01:19:08.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ed98c76-b181-4159-b065-7903e3bf9596 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30462024-11-21T01:19:08.479ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:38509
30472024-11-21T01:19:08.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 27fa3f72-0479-4854-a2b6-145d5ca8cd81 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
30482024-11-21T01:19:08.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 27fa3f72-0479-4854-a2b6-145d5ca8cd81 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
30492024-11-21T01:19:08.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 27fa3f72-0479-4854-a2b6-145d5ca8cd81 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
30502024-11-21T01:19:08.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 392df966-fc00-4f7f-b28c-86008d253833 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
30512024-11-21T01:19:08.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 392df966-fc00-4f7f-b28c-86008d253833 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
30522024-11-21T01:19:08.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 392df966-fc00-4f7f-b28c-86008d253833 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
30532024-11-21T01:19:09.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ea3bb64d-db3a-4111-bc5e-6a79ecc8d5c7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30542024-11-21T01:19:09.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ea3bb64d-db3a-4111-bc5e-6a79ecc8d5c7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30552024-11-21T01:19:09.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ea3bb64d-db3a-4111-bc5e-6a79ecc8d5c7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30562024-11-21T01:19:10.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c36822d4-5daa-4115-be2a-9bcbba95f26a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30572024-11-21T01:19:10.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c36822d4-5daa-4115-be2a-9bcbba95f26a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30582024-11-21T01:19:10.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c36822d4-5daa-4115-be2a-9bcbba95f26a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
30592024-11-21T01:19:11.300ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
30602024-11-21T01:19:11.301ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
30612024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
30622024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.791\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
30632024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30642024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
30652024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
30662024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30672024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30682024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
30692024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
30702024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
30712024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
30722024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
30732024-11-21T01:19:11.301ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:09:11.301075129 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
30742024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30752024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
30762024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
30772024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
30782024-11-21T01:19:11.301ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
30792024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
30802024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30812024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30822024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
30832024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
30842024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30852024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
30862024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30872024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
30882024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
30892024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30902024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
30912024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30922024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
30932024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
30942024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
30952024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30962024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
30972024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30982024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30992024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31002024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31012024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31022024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31032024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31042024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31052024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31062024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31072024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31082024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31092024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31102024-11-21T01:19:11.301ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 201124128 } })
31112024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
31122024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
31132024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31142024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31152024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
31162024-11-21T01:19:11.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31172024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31182024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
31192024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31202024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
31212024-11-21T01:19:11.302ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31222024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31232024-11-21T01:19:11.302ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 201343061 } })
31242024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31252024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31262024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31272024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31282024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31292024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
31302024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
31312024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.271658ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
31322024-11-21T01:19:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.258168ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
31332024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
31342024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31352024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
31362024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31372024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
31382024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
31392024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31402024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31412024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
31422024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31432024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
31442024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31452024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31462024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31472024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
31482024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31492024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31502024-11-21T01:19:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
31512024-11-21T01:19:11.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31522024-11-21T01:19:11.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31532024-11-21T01:19:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31542024-11-21T01:19:11.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 204812740 } })
31552024-11-21T01:19:11.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
31562024-11-21T01:19:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.565154ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31572024-11-21T01:19:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31582024-11-21T01:19:11.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31592024-11-21T01:19:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31602024-11-21T01:19:11.309ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31612024-11-21T01:19:11.310ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:09:11.301075129 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
31622024-11-21T01:19:11.310ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.997957ms iteration = 3 status = {"expiration":"2024-11-21T01:09:11.301075129Z","pruned":[]}
31632024-11-21T01:19:11.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31642024-11-21T01:19:11.311ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 210492810 } })
31652024-11-21T01:19:11.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31662024-11-21T01:19:11.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31672024-11-21T01:19:11.311ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
31682024-11-21T01:19:11.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31692024-11-21T01:19:11.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31702024-11-21T01:19:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31712024-11-21T01:19:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31722024-11-21T01:19:11.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31732024-11-21T01:19:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31742024-11-21T01:19:11.315ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31752024-11-21T01:19:11.315ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31762024-11-21T01:19:11.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31772024-11-21T01:19:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31782024-11-21T01:19:11.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31792024-11-21T01:19:11.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31802024-11-21T01:19:11.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31812024-11-21T01:19:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31822024-11-21T01:19:11.317ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.551185ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
31832024-11-21T01:19:11.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31842024-11-21T01:19:11.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31852024-11-21T01:19:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31862024-11-21T01:19:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31872024-11-21T01:19:11.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31882024-11-21T01:19:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31892024-11-21T01:19:11.326ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1130, tv_nsec: 226165821 } })
31902024-11-21T01:19:11.327ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
31912024-11-21T01:19:11.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31922024-11-21T01:19:11.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31932024-11-21T01:19:11.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31942024-11-21T01:19:11.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31952024-11-21T01:19:11.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31962024-11-21T01:19:11.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31972024-11-21T01:19:11.335ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31982024-11-21T01:19:11.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31992024-11-21T01:19:11.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32002024-11-21T01:19:11.336ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
32012024-11-21T01:19:11.336ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
32022024-11-21T01:19:11.336ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 32.893804ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
32032024-11-21T01:19:11.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32042024-11-21T01:19:11.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32052024-11-21T01:19:11.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32062024-11-21T01:19:11.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32072024-11-21T01:19:11.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32082024-11-21T01:19:11.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32092024-11-21T01:19:11.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32102024-11-21T01:19:11.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32112024-11-21T01:19:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32122024-11-21T01:19:11.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32132024-11-21T01:19:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32142024-11-21T01:19:11.362ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32152024-11-21T01:19:11.362ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32162024-11-21T01:19:11.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32172024-11-21T01:19:11.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182024-11-21T01:19:11.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32192024-11-21T01:19:11.364ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32202024-11-21T01:19:11.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32212024-11-21T01:19:11.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.024024ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
32222024-11-21T01:19:11.365ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32232024-11-21T01:19:11.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32242024-11-21T01:19:11.366ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32252024-11-21T01:19:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32262024-11-21T01:19:11.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32272024-11-21T01:19:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32282024-11-21T01:19:11.368ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.903515ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
32292024-11-21T01:19:11.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
32302024-11-21T01:19:11.368ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32312024-11-21T01:19:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32322024-11-21T01:19:11.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32332024-11-21T01:19:11.372ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32342024-11-21T01:19:11.373ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32352024-11-21T01:19:11.373ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32362024-11-21T01:19:11.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32372024-11-21T01:19:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32382024-11-21T01:19:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32392024-11-21T01:19:11.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32402024-11-21T01:19:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32412024-11-21T01:19:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32422024-11-21T01:19:11.379ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-11-21T01:19:11.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32442024-11-21T01:19:11.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32452024-11-21T01:19:11.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32462024-11-21T01:19:11.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac99806c-b0a6-47c5-855a-9ea8dded6792 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
32472024-11-21T01:19:11.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac99806c-b0a6-47c5-855a-9ea8dded6792 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
32482024-11-21T01:19:11.385ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32492024-11-21T01:19:11.385ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.061781ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32502024-11-21T01:19:11.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac99806c-b0a6-47c5-855a-9ea8dded6792 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
32512024-11-21T01:19:11.387ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32522024-11-21T01:19:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32532024-11-21T01:19:11.388ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32542024-11-21T01:19:11.388ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32552024-11-21T01:19:11.388ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32562024-11-21T01:19:11.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32572024-11-21T01:19:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32582024-11-21T01:19:11.390ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32592024-11-21T01:19:11.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 17f0628f-f360-4b32-bb42-ca859c0d0657 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32602024-11-21T01:19:11.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 17f0628f-f360-4b32-bb42-ca859c0d0657 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32612024-11-21T01:19:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32622024-11-21T01:19:11.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32632024-11-21T01:19:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32642024-11-21T01:19:11.401ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
32652024-11-21T01:19:11.401ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.243252ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
32662024-11-21T01:19:11.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 17f0628f-f360-4b32-bb42-ca859c0d0657 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32672024-11-21T01:19:11.407ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32682024-11-21T01:19:11.407ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
32692024-11-21T01:19:11.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32702024-11-21T01:19:11.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32712024-11-21T01:19:11.410ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32722024-11-21T01:19:11.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32732024-11-21T01:19:11.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32742024-11-21T01:19:11.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32752024-11-21T01:19:11.416ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
32762024-11-21T01:19:11.416ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32772024-11-21T01:19:11.416ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
32782024-11-21T01:19:11.416ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 115.564559ms iteration = 3 status = {"generation":2}
32792024-11-21T01:19:11.421ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 119.102168ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32802024-11-21T01:19:11.422ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32812024-11-21T01:19:11.422ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32822024-11-21T01:19:11.422ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.011595ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32832024-11-21T01:19:11.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.815014ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
32842024-11-21T01:19:11.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32852024-11-21T01:19:11.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32862024-11-21T01:19:11.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32872024-11-21T01:19:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32882024-11-21T01:19:11.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 128.346119ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32892024-11-21T01:19:11.430ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
32902024-11-21T01:19:11.430ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
32912024-11-21T01:19:11.430ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 129.267822ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
32922024-11-21T01:19:11.433ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
32932024-11-21T01:19:11.433ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
32942024-11-21T01:19:11.433ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
32952024-11-21T01:19:11.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32962024-11-21T01:19:11.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32972024-11-21T01:19:11.434ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32982024-11-21T01:19:11.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32992024-11-21T01:19:11.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33002024-11-21T01:19:11.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33012024-11-21T01:19:11.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33022024-11-21T01:19:11.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33032024-11-21T01:19:11.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33042024-11-21T01:19:11.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33052024-11-21T01:19:11.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33062024-11-21T01:19:11.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33072024-11-21T01:19:11.441ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33082024-11-21T01:19:11.445ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33092024-11-21T01:19:11.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
33102024-11-21T01:19:11.462ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33112024-11-21T01:19:11.462ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8db9fd6b-729a-4739-be3f-e76e069b0bb4", "content-length": "26", "date": "Thu, 21 Nov 2024 01:19:10 GMT"} })
33122024-11-21T01:19:11.462ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33132024-11-21T01:19:11.464ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33142024-11-21T01:19:11.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.61958ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
33152024-11-21T01:19:11.471ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33162024-11-21T01:19:11.471ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33172024-11-21T01:19:11.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33182024-11-21T01:19:11.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33192024-11-21T01:19:11.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33202024-11-21T01:19:11.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33212024-11-21T01:19:11.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33222024-11-21T01:19:11.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33232024-11-21T01:19:11.476ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33242024-11-21T01:19:11.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33252024-11-21T01:19:11.480ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
33262024-11-21T01:19:11.480ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33272024-11-21T01:19:11.480ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "defc584d-e74f-4c91-b585-a933afd020d0", "content-length": "26", "date": "Thu, 21 Nov 2024 01:19:10 GMT"} })
33282024-11-21T01:19:11.480ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33292024-11-21T01:19:11.481ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33302024-11-21T01:19:11.493ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
33312024-11-21T01:19:11.493ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 192.012966ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33322024-11-21T01:19:11.504ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 202.884729ms iteration = 7 status = {"physical_disks_added":0}
33332024-11-21T01:19:11.505ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
33342024-11-21T01:19:11.505ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33352024-11-21T01:19:11.506ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5790c6cb-65c4-4059-865c-e20bd76ffef9", "content-length": "26", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
33362024-11-21T01:19:11.506ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33372024-11-21T01:19:11.507ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
33382024-11-21T01:19:11.528ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
33392024-11-21T01:19:11.528ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 226.277469ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33402024-11-21T01:19:11.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33412024-11-21T01:19:11.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33422024-11-21T01:19:11.605ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
33432024-11-21T01:19:11.615ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33442024-11-21T01:19:11.615ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33452024-11-21T01:19:11.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33462024-11-21T01:19:11.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33472024-11-21T01:19:11.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33482024-11-21T01:19:11.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33492024-11-21T01:19:11.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33502024-11-21T01:19:11.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33512024-11-21T01:19:11.620ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
33522024-11-21T01:19:11.620ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33532024-11-21T01:19:11.620ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
33542024-11-21T01:19:11.620ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 318.919844ms iteration = 3 status = {"generation":1}
33552024-11-21T01:19:11.626ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
33562024-11-21T01:19:11.626ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8c9a2af4-17e4-4d39-9915-c9b0e4e02402", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33572024-11-21T01:19:11.626ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33582024-11-21T01:19:11.628ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6226b7fd-1daf-49bc-b47a-6803c3dda796", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33592024-11-21T01:19:11.628ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33602024-11-21T01:19:11.629ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
33612024-11-21T01:19:11.629ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 328.740013ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33622024-11-21T01:19:11.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33632024-11-21T01:19:11.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33642024-11-21T01:19:11.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
33652024-11-21T01:19:11.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33662024-11-21T01:19:11.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33672024-11-21T01:19:11.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33682024-11-21T01:19:11.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33692024-11-21T01:19:11.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33702024-11-21T01:19:11.656ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 354.973963ms iteration = 5 status = 0
33712024-11-21T01:19:11.667ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddb71920-b555-4794-8746-74cf67629528", "content-length": "372", "date": "Thu, 21 Nov 2024 01:19:10 GMT"} })
33722024-11-21T01:19:11.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33732024-11-21T01:19:11.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33742024-11-21T01:19:11.709ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
33752024-11-21T01:19:11.709ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33762024-11-21T01:19:11.712ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "27314a59-6853-447a-af34-15d5fc472f89", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
33772024-11-21T01:19:11.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33782024-11-21T01:19:11.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33792024-11-21T01:19:11.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33802024-11-21T01:19:11.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33812024-11-21T01:19:11.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33822024-11-21T01:19:11.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33832024-11-21T01:19:11.720ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33842024-11-21T01:19:11.720ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33852024-11-21T01:19:11.721ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fc46224c-c1d4-4072-b737-8791d5843af5", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
33862024-11-21T01:19:11.723ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 421.208316ms iteration = 5 status = {}
33872024-11-21T01:19:11.738ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 437.662448ms iteration = 5 status = {}
33882024-11-21T01:19:11.743ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
33892024-11-21T01:19:11.743ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c65a9f33-b0ac-405b-983e-211ea00ec6ea", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33902024-11-21T01:19:11.743ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33912024-11-21T01:19:11.745ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "29bf66c6-f4db-4717-88b9-09735594d6eb", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33922024-11-21T01:19:11.745ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33932024-11-21T01:19:11.746ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2f267a8a-e394-46c3-8141-460d10c2f6e1", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33942024-11-21T01:19:11.746ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33952024-11-21T01:19:11.748ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33962024-11-21T01:19:11.748ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
33972024-11-21T01:19:11.748ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.830101ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33982024-11-21T01:19:11.748ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3def508c-31bb-4e22-8a9f-d8bd3bde9407", "content-length": "1", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
33992024-11-21T01:19:11.750ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34002024-11-21T01:19:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34012024-11-21T01:19:11.752ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 451.386901ms iteration = 5 status = null
34022024-11-21T01:19:11.777ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34032024-11-21T01:19:11.778ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f04e219-d855-4a29-bce9-6a934572b89d", "content-length": "691", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
34042024-11-21T01:19:11.778ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
34052024-11-21T01:19:11.778ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
34062024-11-21T01:19:11.778ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
34072024-11-21T01:19:11.780ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 479.292494ms iteration = 5 status = {}
34082024-11-21T01:19:11.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34092024-11-21T01:19:11.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34102024-11-21T01:19:11.799ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
34112024-11-21T01:19:11.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34122024-11-21T01:19:11.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34132024-11-21T01:19:11.960ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34142024-11-21T01:19:11.960ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "364e8c72-5151-4107-ab8a-77e9fc9a5f5f", "content-length": "134", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
34152024-11-21T01:19:11.960ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34162024-11-21T01:19:11.960ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
34172024-11-21T01:19:11.960ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34182024-11-21T01:19:11.960ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34192024-11-21T01:19:11.960ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34202024-11-21T01:19:11.960ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34212024-11-21T01:19:11.960ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34222024-11-21T01:19:11.960ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34232024-11-21T01:19:11.961ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34242024-11-21T01:19:11.961ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34252024-11-21T01:19:11.961ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
34262024-11-21T01:19:11.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34272024-11-21T01:19:11.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34282024-11-21T01:19:11.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34292024-11-21T01:19:11.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6d8d1a9-464c-4083-b8ba-5ec51a58ff14", "content-length": "2", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
34302024-11-21T01:19:11.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
34312024-11-21T01:19:11.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f233d48-eaa3-4c8f-b6ff-63c7cb65d8ed", "content-length": "51", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
34322024-11-21T01:19:11.964ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
34332024-11-21T01:19:11.964ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
34342024-11-21T01:19:12.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "22bba7b2-26c9-42aa-94c3-d3684d672378", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
34352024-11-21T01:19:12.056ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
34362024-11-21T01:19:12.056ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
34372024-11-21T01:19:12.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d084dc88-5170-4417-bae4-39b512050b66", "content-length": "682", "date": "Thu, 21 Nov 2024 01:19:11 GMT"} })
34382024-11-21T01:19:12.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34392024-11-21T01:19:12.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34402024-11-21T01:19:12.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34412024-11-21T01:19:12.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34422024-11-21T01:19:12.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34432024-11-21T01:19:12.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34442024-11-21T01:19:12.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34452024-11-21T01:19:12.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34462024-11-21T01:19:12.073ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 771.998559ms iteration = 5 status = {}
34472024-11-21T01:19:12.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01034039-0880-4246-864a-adfd47b789e4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34482024-11-21T01:19:12.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01034039-0880-4246-864a-adfd47b789e4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34492024-11-21T01:19:12.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01034039-0880-4246-864a-adfd47b789e4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34502024-11-21T01:19:13.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ff9e6a2-f52d-4cf4-b1e9-3d716ff8bf39 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34512024-11-21T01:19:13.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ff9e6a2-f52d-4cf4-b1e9-3d716ff8bf39 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34522024-11-21T01:19:13.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ff9e6a2-f52d-4cf4-b1e9-3d716ff8bf39 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34532024-11-21T01:19:14.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 91a63540-a844-4376-bed0-bc6e8c635515 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34542024-11-21T01:19:14.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 91a63540-a844-4376-bed0-bc6e8c635515 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34552024-11-21T01:19:14.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 91a63540-a844-4376-bed0-bc6e8c635515 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34562024-11-21T01:19:15.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ada6b505-2025-4321-92e8-24fbef881501 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34572024-11-21T01:19:15.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ada6b505-2025-4321-92e8-24fbef881501 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34582024-11-21T01:19:15.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ada6b505-2025-4321-92e8-24fbef881501 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34592024-11-21T01:19:16.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 479050e0-7ba4-42ce-93ed-0166dd3eeb01 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34602024-11-21T01:19:16.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 479050e0-7ba4-42ce-93ed-0166dd3eeb01 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34612024-11-21T01:19:16.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 479050e0-7ba4-42ce-93ed-0166dd3eeb01 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34622024-11-21T01:19:17.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c71943ea-d3be-40e8-ad35-92c78d70b26e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34632024-11-21T01:19:17.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c71943ea-d3be-40e8-ad35-92c78d70b26e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34642024-11-21T01:19:17.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c71943ea-d3be-40e8-ad35-92c78d70b26e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34652024-11-21T01:19:18.490ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 552 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 58e6c4ac-dacd-4774-a0ed-efafe7cb2041 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
34662024-11-21T01:19:18.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 99b90315-181d-4ef2-912a-1e52f9afe48d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34672024-11-21T01:19:18.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 99b90315-181d-4ef2-912a-1e52f9afe48d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34682024-11-21T01:19:18.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 99b90315-181d-4ef2-912a-1e52f9afe48d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34692024-11-21T01:19:19.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf8aada9-f2f8-4403-a37c-cfdd56c57b48 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34702024-11-21T01:19:19.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf8aada9-f2f8-4403-a37c-cfdd56c57b48 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34712024-11-21T01:19:19.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf8aada9-f2f8-4403-a37c-cfdd56c57b48 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34722024-11-21T01:19:20.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f4fc9d0a-a990-43c3-8da9-f078cc3272c2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34732024-11-21T01:19:20.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f4fc9d0a-a990-43c3-8da9-f078cc3272c2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34742024-11-21T01:19:20.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f4fc9d0a-a990-43c3-8da9-f078cc3272c2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34752024-11-21T01:19:21.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
34762024-11-21T01:19:21.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34772024-11-21T01:19:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34782024-11-21T01:19:21.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
34792024-11-21T01:19:21.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34802024-11-21T01:19:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34812024-11-21T01:19:21.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34822024-11-21T01:19:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34832024-11-21T01:19:21.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34842024-11-21T01:19:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34852024-11-21T01:19:21.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34862024-11-21T01:19:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34872024-11-21T01:19:21.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882024-11-21T01:19:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
34892024-11-21T01:19:21.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34902024-11-21T01:19:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34912024-11-21T01:19:21.326ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
34922024-11-21T01:19:21.326ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.754079ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
34932024-11-21T01:19:21.331ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34942024-11-21T01:19:21.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34952024-11-21T01:19:21.360ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.730818ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34962024-11-21T01:19:21.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7635cc63-1394-40f2-b5cf-49d44abbca30 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34972024-11-21T01:19:21.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7635cc63-1394-40f2-b5cf-49d44abbca30 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34982024-11-21T01:19:21.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7635cc63-1394-40f2-b5cf-49d44abbca30 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
34992024-11-21T01:19:22.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e4ac7427-50a0-4e43-afe4-2bf7c81797c2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35002024-11-21T01:19:22.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e4ac7427-50a0-4e43-afe4-2bf7c81797c2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35012024-11-21T01:19:22.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e4ac7427-50a0-4e43-afe4-2bf7c81797c2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35022024-11-21T01:19:23.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 3b645df3-fc20-4cb8-89d5-fccc74550389 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
35032024-11-21T01:19:23.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 3b645df3-fc20-4cb8-89d5-fccc74550389 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
35042024-11-21T01:19:23.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 3b645df3-fc20-4cb8-89d5-fccc74550389 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
35052024-11-21T01:19:23.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = d38bd9c9-2750-434f-aaed-f3b16f4cfbbc roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
35062024-11-21T01:19:23.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = d38bd9c9-2750-434f-aaed-f3b16f4cfbbc resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
35072024-11-21T01:19:23.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = d38bd9c9-2750-434f-aaed-f3b16f4cfbbc response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
35082024-11-21T01:19:23.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4f403971-0d28-49b1-8a40-ce61cce9591d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35092024-11-21T01:19:23.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4f403971-0d28-49b1-8a40-ce61cce9591d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35102024-11-21T01:19:23.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4f403971-0d28-49b1-8a40-ce61cce9591d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35112024-11-21T01:19:24.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ef8d5ed-c461-4e8c-9d70-8d8ff89a25f9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35122024-11-21T01:19:24.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ef8d5ed-c461-4e8c-9d70-8d8ff89a25f9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35132024-11-21T01:19:24.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ef8d5ed-c461-4e8c-9d70-8d8ff89a25f9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35142024-11-21T01:19:25.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ad41295f-7b35-4576-9f5a-cefaf1938d9d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35152024-11-21T01:19:25.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ad41295f-7b35-4576-9f5a-cefaf1938d9d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35162024-11-21T01:19:25.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ad41295f-7b35-4576-9f5a-cefaf1938d9d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35172024-11-21T01:19:26.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87bddb74-f255-49f4-8bea-9440012528c9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35182024-11-21T01:19:26.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87bddb74-f255-49f4-8bea-9440012528c9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35192024-11-21T01:19:26.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87bddb74-f255-49f4-8bea-9440012528c9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35202024-11-21T01:19:27.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb0e4190-812a-4bb6-b797-d55de650d36b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35212024-11-21T01:19:27.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb0e4190-812a-4bb6-b797-d55de650d36b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35222024-11-21T01:19:27.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb0e4190-812a-4bb6-b797-d55de650d36b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35232024-11-21T01:19:28.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 84951362-02fa-4ea7-81d3-856859ef08d6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35242024-11-21T01:19:28.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 84951362-02fa-4ea7-81d3-856859ef08d6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35252024-11-21T01:19:28.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 84951362-02fa-4ea7-81d3-856859ef08d6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35262024-11-21T01:19:29.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fd182ea-f8da-4f8e-8151-1a8f8ae0849b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35272024-11-21T01:19:29.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fd182ea-f8da-4f8e-8151-1a8f8ae0849b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35282024-11-21T01:19:29.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fd182ea-f8da-4f8e-8151-1a8f8ae0849b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35292024-11-21T01:19:30.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36010e1d-f9e4-4596-aa1e-315b9fcf09f8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35302024-11-21T01:19:30.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36010e1d-f9e4-4596-aa1e-315b9fcf09f8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35312024-11-21T01:19:30.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36010e1d-f9e4-4596-aa1e-315b9fcf09f8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35322024-11-21T01:19:31.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
35332024-11-21T01:19:31.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35342024-11-21T01:19:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35352024-11-21T01:19:31.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
35362024-11-21T01:19:31.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35372024-11-21T01:19:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35382024-11-21T01:19:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35392024-11-21T01:19:31.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35402024-11-21T01:19:31.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35412024-11-21T01:19:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35422024-11-21T01:19:31.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35432024-11-21T01:19:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35442024-11-21T01:19:31.329ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35452024-11-21T01:19:31.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35462024-11-21T01:19:31.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.547602ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35472024-11-21T01:19:31.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-11-21T01:19:31.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
35492024-11-21T01:19:31.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35502024-11-21T01:19:31.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35512024-11-21T01:19:31.353ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
35522024-11-21T01:19:31.353ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.090824ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
35532024-11-21T01:19:31.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0e08d6b2-5dda-4246-b6d2-4a091bdb1e9e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35542024-11-21T01:19:31.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0e08d6b2-5dda-4246-b6d2-4a091bdb1e9e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35552024-11-21T01:19:31.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0e08d6b2-5dda-4246-b6d2-4a091bdb1e9e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35562024-11-21T01:19:32.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e70970f-fd8d-4f29-9e64-c9ba967389bc roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35572024-11-21T01:19:32.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e70970f-fd8d-4f29-9e64-c9ba967389bc resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35582024-11-21T01:19:32.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e70970f-fd8d-4f29-9e64-c9ba967389bc response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35592024-11-21T01:19:33.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 859 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = bf55640b-e1bd-4446-9fd6-236536ab9cb2 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
35602024-11-21T01:19:33.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bc1e2c26-5a62-48fa-8d1f-46af72c5f436 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35612024-11-21T01:19:33.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bc1e2c26-5a62-48fa-8d1f-46af72c5f436 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35622024-11-21T01:19:33.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bc1e2c26-5a62-48fa-8d1f-46af72c5f436 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35632024-11-21T01:19:34.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1fde086c-01db-453f-a88f-aac90d9d3b83 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35642024-11-21T01:19:34.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1fde086c-01db-453f-a88f-aac90d9d3b83 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35652024-11-21T01:19:34.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1fde086c-01db-453f-a88f-aac90d9d3b83 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35662024-11-21T01:19:35.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 427eb577-bf06-4c6c-a1ac-8716a79d56d4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35672024-11-21T01:19:35.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 427eb577-bf06-4c6c-a1ac-8716a79d56d4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35682024-11-21T01:19:35.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 427eb577-bf06-4c6c-a1ac-8716a79d56d4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35692024-11-21T01:19:36.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8b0a2344-29dd-4514-8203-95182e04f2b9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35702024-11-21T01:19:36.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8b0a2344-29dd-4514-8203-95182e04f2b9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35712024-11-21T01:19:36.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8b0a2344-29dd-4514-8203-95182e04f2b9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35722024-11-21T01:19:37.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa634009-7eec-4ac9-b4f5-4e8c71d472d1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35732024-11-21T01:19:37.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa634009-7eec-4ac9-b4f5-4e8c71d472d1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35742024-11-21T01:19:37.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa634009-7eec-4ac9-b4f5-4e8c71d472d1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35752024-11-21T01:19:38.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 873ce907-c604-45e9-b97f-90c41174a1b2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35762024-11-21T01:19:38.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 873ce907-c604-45e9-b97f-90c41174a1b2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35772024-11-21T01:19:38.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 873ce907-c604-45e9-b97f-90c41174a1b2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35782024-11-21T01:19:40.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 18d69c66-84ff-4a4e-9ffb-77cce7c6bf2b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35792024-11-21T01:19:40.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 18d69c66-84ff-4a4e-9ffb-77cce7c6bf2b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35802024-11-21T01:19:40.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 18d69c66-84ff-4a4e-9ffb-77cce7c6bf2b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35812024-11-21T01:19:41.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a585c189-9293-45fb-bc0a-27d05d3dd9aa roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35822024-11-21T01:19:41.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a585c189-9293-45fb-bc0a-27d05d3dd9aa resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35832024-11-21T01:19:41.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a585c189-9293-45fb-bc0a-27d05d3dd9aa response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
35842024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
35852024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35862024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
35872024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35882024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
35892024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
35902024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35912024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35922024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
35932024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
35942024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35952024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
35962024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
35972024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35982024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35992024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
36002024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36012024-11-21T01:19:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36022024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36032024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36042024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36052024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36062024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36072024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36082024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36092024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
36102024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
36112024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36122024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36132024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36142024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
36152024-11-21T01:19:41.302ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36162024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36172024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
36182024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36192024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36202024-11-21T01:19:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36212024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36222024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36232024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
36242024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
36252024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36262024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36272024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
36282024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36292024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
36302024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36312024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36322024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36332024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36342024-11-21T01:19:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36352024-11-21T01:19:41.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36362024-11-21T01:19:41.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1160, tv_nsec: 204560237 } })
36372024-11-21T01:19:41.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
36382024-11-21T01:19:41.306ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.390012ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36392024-11-21T01:19:41.306ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1160, tv_nsec: 205763083 } })
36402024-11-21T01:19:41.306ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
36412024-11-21T01:19:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36422024-11-21T01:19:41.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36432024-11-21T01:19:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36442024-11-21T01:19:41.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36452024-11-21T01:19:41.311ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36462024-11-21T01:19:41.311ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36472024-11-21T01:19:41.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36482024-11-21T01:19:41.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36492024-11-21T01:19:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36502024-11-21T01:19:41.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512024-11-21T01:19:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36522024-11-21T01:19:41.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36532024-11-21T01:19:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36542024-11-21T01:19:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36552024-11-21T01:19:41.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36562024-11-21T01:19:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36572024-11-21T01:19:41.314ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36582024-11-21T01:19:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36592024-11-21T01:19:41.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36602024-11-21T01:19:41.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36612024-11-21T01:19:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36622024-11-21T01:19:41.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36632024-11-21T01:19:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36642024-11-21T01:19:41.320ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 18.145836ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36652024-11-21T01:19:41.321ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1160, tv_nsec: 220447910 } })
36662024-11-21T01:19:41.321ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
36672024-11-21T01:19:41.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36682024-11-21T01:19:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36692024-11-21T01:19:41.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36702024-11-21T01:19:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36712024-11-21T01:19:41.355ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36722024-11-21T01:19:41.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36732024-11-21T01:19:41.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36742024-11-21T01:19:41.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36752024-11-21T01:19:41.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.660482ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
36762024-11-21T01:19:41.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.10457ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36772024-11-21T01:19:41.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.521573ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
36782024-11-21T01:19:41.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36792024-11-21T01:19:41.360ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36802024-11-21T01:19:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36812024-11-21T01:19:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36822024-11-21T01:19:41.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36832024-11-21T01:19:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36842024-11-21T01:19:41.361ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36852024-11-21T01:19:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36862024-11-21T01:19:41.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.710096ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36872024-11-21T01:19:41.364ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36882024-11-21T01:19:41.364ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36892024-11-21T01:19:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36902024-11-21T01:19:41.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36912024-11-21T01:19:41.365ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36922024-11-21T01:19:41.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36932024-11-21T01:19:41.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36942024-11-21T01:19:41.367ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36952024-11-21T01:19:41.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36962024-11-21T01:19:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36972024-11-21T01:19:41.369ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36982024-11-21T01:19:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36992024-11-21T01:19:41.369ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37002024-11-21T01:19:41.369ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37012024-11-21T01:19:41.369ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37022024-11-21T01:19:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37032024-11-21T01:19:41.370ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37042024-11-21T01:19:41.370ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.045699ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37052024-11-21T01:19:41.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062024-11-21T01:19:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
37072024-11-21T01:19:41.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37082024-11-21T01:19:41.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37092024-11-21T01:19:41.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37102024-11-21T01:19:41.395ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
37112024-11-21T01:19:41.395ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37122024-11-21T01:19:41.396ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "adcc5d31-7913-43ff-8080-98ac1042f6e8", "content-length": "26", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
37132024-11-21T01:19:41.396ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37142024-11-21T01:19:41.398ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37152024-11-21T01:19:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37162024-11-21T01:19:41.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37172024-11-21T01:19:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37182024-11-21T01:19:41.400ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
37192024-11-21T01:19:41.400ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37202024-11-21T01:19:41.400ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85dee7b8-718a-4515-9725-219e642cbf6e", "content-length": "26", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
37212024-11-21T01:19:41.400ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37222024-11-21T01:19:41.401ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37232024-11-21T01:19:41.401ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37242024-11-21T01:19:41.401ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.370676ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37252024-11-21T01:19:41.402ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37262024-11-21T01:19:41.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37272024-11-21T01:19:41.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37282024-11-21T01:19:41.406ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
37292024-11-21T01:19:41.406ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 104.616544ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
37302024-11-21T01:19:41.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312024-11-21T01:19:41.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
37322024-11-21T01:19:41.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37332024-11-21T01:19:41.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37342024-11-21T01:19:41.419ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
37352024-11-21T01:19:41.419ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37362024-11-21T01:19:41.420ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23dcefc8-d4e9-43c7-b527-8e111c1ba248", "content-length": "26", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
37372024-11-21T01:19:41.420ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37382024-11-21T01:19:41.422ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
37392024-11-21T01:19:41.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = babc0a76-247f-4320-afeb-9c6d325b2e75 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37402024-11-21T01:19:41.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = babc0a76-247f-4320-afeb-9c6d325b2e75 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37412024-11-21T01:19:41.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37422024-11-21T01:19:41.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37432024-11-21T01:19:41.487ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37442024-11-21T01:19:41.487ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37452024-11-21T01:19:41.487ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7993ee68-2052-4b3b-8af7-6636b0a0f81a", "content-length": "372", "date": "Thu, 21 Nov 2024 01:19:40 GMT"} })
37462024-11-21T01:19:41.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37472024-11-21T01:19:41.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37482024-11-21T01:19:41.490ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 188.964213ms iteration = 6 status = 0
37492024-11-21T01:19:41.490ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37502024-11-21T01:19:41.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = babc0a76-247f-4320-afeb-9c6d325b2e75 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37512024-11-21T01:19:41.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37522024-11-21T01:19:41.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37532024-11-21T01:19:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37542024-11-21T01:19:41.509ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37552024-11-21T01:19:41.509ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1aae01e-bbfc-49cb-ba21-022dafeb2ece", "content-length": "1", "date": "Thu, 21 Nov 2024 01:19:40 GMT"} })
37562024-11-21T01:19:41.512ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37572024-11-21T01:19:41.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37582024-11-21T01:19:41.515ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 213.897745ms iteration = 6 status = null
37592024-11-21T01:19:41.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 223.771904ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37602024-11-21T01:19:41.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37612024-11-21T01:19:41.532ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37622024-11-21T01:19:41.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37632024-11-21T01:19:41.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37642024-11-21T01:19:41.538ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37652024-11-21T01:19:41.538ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37662024-11-21T01:19:41.571ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 270.451241ms iteration = 6 status = {}
37672024-11-21T01:19:41.592ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 290.392502ms iteration = 8 status = {"physical_disks_added":0}
37682024-11-21T01:19:41.599ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9d17463b-7ec1-4f51-a0dd-9e49deaa9689", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
37692024-11-21T01:19:41.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37702024-11-21T01:19:41.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37712024-11-21T01:19:41.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37722024-11-21T01:19:41.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37732024-11-21T01:19:41.646ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37742024-11-21T01:19:41.646ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c9f6b0d-37be-4ebc-924f-45fb2ff13cde", "content-length": "691", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
37752024-11-21T01:19:41.646ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37762024-11-21T01:19:41.646ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37772024-11-21T01:19:41.646ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37782024-11-21T01:19:41.648ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.358424ms iteration = 6 status = {}
37792024-11-21T01:19:41.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37802024-11-21T01:19:41.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37812024-11-21T01:19:41.652ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37822024-11-21T01:19:41.652ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37832024-11-21T01:19:41.652ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b19a07d-8d66-4c97-9d15-b6e23cd75e90", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
37842024-11-21T01:19:41.654ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 351.466933ms iteration = 6 status = {}
37852024-11-21T01:19:41.661ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37862024-11-21T01:19:41.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37872024-11-21T01:19:41.663ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
37882024-11-21T01:19:41.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37892024-11-21T01:19:41.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37902024-11-21T01:19:41.671ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37912024-11-21T01:19:41.672ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaeb614c-2076-4258-974d-c85e5ab75d9f", "content-length": "134", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
37922024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37932024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
37942024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37952024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37962024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37972024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37982024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37992024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38002024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38012024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38022024-11-21T01:19:41.672ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
38032024-11-21T01:19:41.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38042024-11-21T01:19:41.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38052024-11-21T01:19:41.675ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38062024-11-21T01:19:41.675ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a2e0147-e149-43ec-9426-2f8873a66d72", "content-length": "2", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
38072024-11-21T01:19:41.675ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38082024-11-21T01:19:41.675ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0955c15-d0e5-4ae5-824c-9aeca607c6a1", "content-length": "51", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
38092024-11-21T01:19:41.675ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
38102024-11-21T01:19:41.675ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38112024-11-21T01:19:41.770ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0293d8a0-2d3f-4aae-9eaa-23f70dc9e439", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
38122024-11-21T01:19:41.770ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
38132024-11-21T01:19:41.770ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38142024-11-21T01:19:41.770ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a381fb04-bc9d-40c2-9951-a5b590384ec3", "content-length": "682", "date": "Thu, 21 Nov 2024 01:19:41 GMT"} })
38152024-11-21T01:19:41.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38162024-11-21T01:19:41.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38172024-11-21T01:19:41.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38182024-11-21T01:19:41.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38192024-11-21T01:19:41.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38202024-11-21T01:19:41.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38212024-11-21T01:19:41.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38222024-11-21T01:19:41.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38232024-11-21T01:19:41.994ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 693.2906ms iteration = 6 status = {}
38242024-11-21T01:19:42.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0f14e1b0-f97e-4c89-a182-b032320cb88c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38252024-11-21T01:19:42.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0f14e1b0-f97e-4c89-a182-b032320cb88c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38262024-11-21T01:19:42.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0f14e1b0-f97e-4c89-a182-b032320cb88c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38272024-11-21T01:19:43.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1636a77b-d385-44b6-b4c4-6501a983eedb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38282024-11-21T01:19:43.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1636a77b-d385-44b6-b4c4-6501a983eedb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38292024-11-21T01:19:43.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1636a77b-d385-44b6-b4c4-6501a983eedb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38302024-11-21T01:19:44.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 891435d8-11a9-4f32-84c6-75f0d546ae43 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38312024-11-21T01:19:44.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 891435d8-11a9-4f32-84c6-75f0d546ae43 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38322024-11-21T01:19:44.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 891435d8-11a9-4f32-84c6-75f0d546ae43 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38332024-11-21T01:19:45.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 74a0e22c-86ab-48c7-91ed-1edb1aebed58 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38342024-11-21T01:19:45.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 74a0e22c-86ab-48c7-91ed-1edb1aebed58 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38352024-11-21T01:19:45.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 74a0e22c-86ab-48c7-91ed-1edb1aebed58 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38362024-11-21T01:19:46.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45642029-b4fb-47d5-a93c-070374788668 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38372024-11-21T01:19:46.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45642029-b4fb-47d5-a93c-070374788668 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38382024-11-21T01:19:46.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45642029-b4fb-47d5-a93c-070374788668 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38392024-11-21T01:19:47.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 315f9c1e-88f8-4d7f-a7c1-2abb7e8a2f47 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38402024-11-21T01:19:47.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 315f9c1e-88f8-4d7f-a7c1-2abb7e8a2f47 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38412024-11-21T01:19:47.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 315f9c1e-88f8-4d7f-a7c1-2abb7e8a2f47 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38422024-11-21T01:19:48.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 14873e5c-c890-4cd4-8e65-7170bf903a39 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38432024-11-21T01:19:48.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 14873e5c-c890-4cd4-8e65-7170bf903a39 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38442024-11-21T01:19:48.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 14873e5c-c890-4cd4-8e65-7170bf903a39 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38452024-11-21T01:19:48.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 28feda92-b90b-4c5f-80a3-9cc1abb32779 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
38462024-11-21T01:19:49.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a7f81f06-0066-46a5-b8fe-81d025819410 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38472024-11-21T01:19:49.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a7f81f06-0066-46a5-b8fe-81d025819410 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38482024-11-21T01:19:49.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a7f81f06-0066-46a5-b8fe-81d025819410 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38492024-11-21T01:19:50.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6ed64b7f-df95-4d15-ae49-e5eb540889b0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38502024-11-21T01:19:50.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6ed64b7f-df95-4d15-ae49-e5eb540889b0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38512024-11-21T01:19:50.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6ed64b7f-df95-4d15-ae49-e5eb540889b0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38522024-11-21T01:19:51.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5d1ddb3-b322-4acb-a830-577f9ef9a7f1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38532024-11-21T01:19:51.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5d1ddb3-b322-4acb-a830-577f9ef9a7f1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38542024-11-21T01:19:51.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5d1ddb3-b322-4acb-a830-577f9ef9a7f1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38552024-11-21T01:19:51.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
38562024-11-21T01:19:51.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38572024-11-21T01:19:51.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38582024-11-21T01:19:51.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
38592024-11-21T01:19:51.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38602024-11-21T01:19:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38612024-11-21T01:19:51.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38622024-11-21T01:19:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38632024-11-21T01:19:51.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38642024-11-21T01:19:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38652024-11-21T01:19:51.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38662024-11-21T01:19:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38672024-11-21T01:19:51.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38682024-11-21T01:19:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
38692024-11-21T01:19:51.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38702024-11-21T01:19:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38712024-11-21T01:19:51.321ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
38722024-11-21T01:19:51.321ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.435748ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
38732024-11-21T01:19:51.331ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38742024-11-21T01:19:51.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38752024-11-21T01:19:51.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.313158ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38762024-11-21T01:19:52.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 17947b0f-8169-4eab-9d60-102d003c32e0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38772024-11-21T01:19:52.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 17947b0f-8169-4eab-9d60-102d003c32e0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38782024-11-21T01:19:52.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 17947b0f-8169-4eab-9d60-102d003c32e0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38792024-11-21T01:19:53.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a0e0d1da-fb56-4d55-bae4-87893a53ef3c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38802024-11-21T01:19:53.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a0e0d1da-fb56-4d55-bae4-87893a53ef3c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38812024-11-21T01:19:53.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a0e0d1da-fb56-4d55-bae4-87893a53ef3c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38822024-11-21T01:19:53.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 0cbc36d6-3cfd-4b69-8939-312a2015a1fa roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
38832024-11-21T01:19:53.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 0cbc36d6-3cfd-4b69-8939-312a2015a1fa resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
38842024-11-21T01:19:53.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 0cbc36d6-3cfd-4b69-8939-312a2015a1fa response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
38852024-11-21T01:19:53.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 142ed981-6afd-4855-ac41-a878f9d3e34f roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
38862024-11-21T01:19:53.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 142ed981-6afd-4855-ac41-a878f9d3e34f resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
38872024-11-21T01:19:53.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:38509 req_id = 142ed981-6afd-4855-ac41-a878f9d3e34f response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
38882024-11-21T01:19:54.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 429af513-902d-4e82-94bb-fad86c58dc79 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38892024-11-21T01:19:54.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 429af513-902d-4e82-94bb-fad86c58dc79 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38902024-11-21T01:19:54.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 429af513-902d-4e82-94bb-fad86c58dc79 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38912024-11-21T01:19:55.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e804aa8-e146-4483-8e72-7ae8754f59ad roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38922024-11-21T01:19:55.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e804aa8-e146-4483-8e72-7ae8754f59ad resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38932024-11-21T01:19:55.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e804aa8-e146-4483-8e72-7ae8754f59ad response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38942024-11-21T01:19:56.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fd46da0-3743-4072-8604-2b4816232b40 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38952024-11-21T01:19:56.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fd46da0-3743-4072-8604-2b4816232b40 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38962024-11-21T01:19:56.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fd46da0-3743-4072-8604-2b4816232b40 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38972024-11-21T01:19:57.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 85dddd6b-d5fd-427c-bc4e-b227d06d737d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38982024-11-21T01:19:57.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 85dddd6b-d5fd-427c-bc4e-b227d06d737d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
38992024-11-21T01:19:57.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 85dddd6b-d5fd-427c-bc4e-b227d06d737d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39002024-11-21T01:19:58.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 649d45ec-6e22-4e9f-861f-5bd3580637b8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39012024-11-21T01:19:58.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 649d45ec-6e22-4e9f-861f-5bd3580637b8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39022024-11-21T01:19:58.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 649d45ec-6e22-4e9f-861f-5bd3580637b8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39032024-11-21T01:19:59.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b9ed1abe-9efc-42f7-bf00-7f7349d73841 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39042024-11-21T01:19:59.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b9ed1abe-9efc-42f7-bf00-7f7349d73841 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39052024-11-21T01:19:59.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b9ed1abe-9efc-42f7-bf00-7f7349d73841 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39062024-11-21T01:20:00.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9c4e6329-6423-4f81-8e14-14006a781dde roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39072024-11-21T01:20:00.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9c4e6329-6423-4f81-8e14-14006a781dde resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39082024-11-21T01:20:00.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9c4e6329-6423-4f81-8e14-14006a781dde response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39092024-11-21T01:20:01.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
39102024-11-21T01:20:01.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39112024-11-21T01:20:01.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39122024-11-21T01:20:01.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
39132024-11-21T01:20:01.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39142024-11-21T01:20:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39152024-11-21T01:20:01.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39162024-11-21T01:20:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39172024-11-21T01:20:01.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39182024-11-21T01:20:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39192024-11-21T01:20:01.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39202024-11-21T01:20:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39212024-11-21T01:20:01.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39222024-11-21T01:20:01.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
39232024-11-21T01:20:01.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39242024-11-21T01:20:01.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39252024-11-21T01:20:01.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
39262024-11-21T01:20:01.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.791861ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
39272024-11-21T01:20:01.331ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39282024-11-21T01:20:01.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39292024-11-21T01:20:01.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 462f5421-1d41-416e-8ac7-335193a29c24 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39302024-11-21T01:20:01.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 462f5421-1d41-416e-8ac7-335193a29c24 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39312024-11-21T01:20:01.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 462f5421-1d41-416e-8ac7-335193a29c24 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39322024-11-21T01:20:01.473ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 171.66715ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39332024-11-21T01:20:02.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce4cc74b-3f92-418f-a1cb-aad128b4b140 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39342024-11-21T01:20:02.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce4cc74b-3f92-418f-a1cb-aad128b4b140 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39352024-11-21T01:20:02.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce4cc74b-3f92-418f-a1cb-aad128b4b140 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39362024-11-21T01:20:03.486ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 867 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 13cf291c-6971-4bb6-b4cf-9651e20aeb9f response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
39372024-11-21T01:20:03.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8c95f558-c740-4a69-99cc-6102df50f866 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39382024-11-21T01:20:03.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8c95f558-c740-4a69-99cc-6102df50f866 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39392024-11-21T01:20:03.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8c95f558-c740-4a69-99cc-6102df50f866 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39402024-11-21T01:20:04.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e4fc551-0c39-4912-a325-853ed16b5dfd roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39412024-11-21T01:20:04.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e4fc551-0c39-4912-a325-853ed16b5dfd resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39422024-11-21T01:20:04.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e4fc551-0c39-4912-a325-853ed16b5dfd response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39432024-11-21T01:20:05.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e191cd11-d393-4cf4-a970-edd40663c22f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39442024-11-21T01:20:05.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e191cd11-d393-4cf4-a970-edd40663c22f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39452024-11-21T01:20:05.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e191cd11-d393-4cf4-a970-edd40663c22f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39462024-11-21T01:20:06.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 98c2812f-e7bd-426a-b1d3-246d60e128b4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39472024-11-21T01:20:06.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 98c2812f-e7bd-426a-b1d3-246d60e128b4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39482024-11-21T01:20:06.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 98c2812f-e7bd-426a-b1d3-246d60e128b4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39492024-11-21T01:20:07.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cd17447-d0ba-487d-b550-07661e1dc747 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39502024-11-21T01:20:07.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cd17447-d0ba-487d-b550-07661e1dc747 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39512024-11-21T01:20:07.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cd17447-d0ba-487d-b550-07661e1dc747 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39522024-11-21T01:20:08.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 91261cce-1601-4de3-94ec-10f08260c80c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39532024-11-21T01:20:08.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 91261cce-1601-4de3-94ec-10f08260c80c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39542024-11-21T01:20:08.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 91261cce-1601-4de3-94ec-10f08260c80c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39552024-11-21T01:20:09.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 16211263-eff9-4f16-be59-c1da28ecd55b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39562024-11-21T01:20:09.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 16211263-eff9-4f16-be59-c1da28ecd55b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39572024-11-21T01:20:09.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 16211263-eff9-4f16-be59-c1da28ecd55b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39582024-11-21T01:20:10.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 024ed10d-a48e-4edb-a0c9-011640cfb8ed roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39592024-11-21T01:20:10.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 024ed10d-a48e-4edb-a0c9-011640cfb8ed resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39602024-11-21T01:20:10.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 024ed10d-a48e-4edb-a0c9-011640cfb8ed response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
39612024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
39622024-11-21T01:20:11.301ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
39632024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 25.06\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
39642024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
39652024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
39662024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
39672024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39682024-11-21T01:20:11.301ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:10:11.301259826 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39692024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39702024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
39712024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
39722024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39732024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
39742024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
39752024-11-21T01:20:11.301ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39762024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39772024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39782024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
39792024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
39802024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39812024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
39822024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39832024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39842024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
39852024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
39862024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39872024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
39882024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39892024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39902024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
39912024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39922024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39932024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
39942024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
39952024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39962024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
39972024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39982024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
39992024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
40002024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40012024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40022024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40032024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40042024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40052024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40062024-11-21T01:20:11.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40072024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40082024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40092024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40102024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40112024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40122024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40132024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
40142024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40152024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40162024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
40172024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
40182024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40192024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40202024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40212024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
40222024-11-21T01:20:11.302ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40232024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40242024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
40252024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40262024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40272024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40282024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40292024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40302024-11-21T01:20:11.302ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 201299559 } })
40312024-11-21T01:20:11.302ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 201318800 } })
40322024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40332024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40342024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40352024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40362024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40372024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40382024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40392024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
40402024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.350689ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
40412024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
40422024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40432024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.597313ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
40442024-11-21T01:20:11.302ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40452024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40462024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
40472024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40482024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
40492024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
40502024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40512024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40522024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
40532024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40542024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
40552024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40562024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
40572024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40582024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40592024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40602024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40612024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40622024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40632024-11-21T01:20:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40642024-11-21T01:20:11.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 204012848 } })
40652024-11-21T01:20:11.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
40662024-11-21T01:20:11.306ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 205141554 } })
40672024-11-21T01:20:11.306ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.674166ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40682024-11-21T01:20:11.306ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
40692024-11-21T01:20:11.306ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702024-11-21T01:20:11.306ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:10:11.301259826 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40712024-11-21T01:20:11.306ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.704201ms iteration = 4 status = {"expiration":"2024-11-21T01:10:11.301259826Z","pruned":[]}
40722024-11-21T01:20:11.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732024-11-21T01:20:11.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40742024-11-21T01:20:11.309ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40752024-11-21T01:20:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40762024-11-21T01:20:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40772024-11-21T01:20:11.310ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40782024-11-21T01:20:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40792024-11-21T01:20:11.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40802024-11-21T01:20:11.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40812024-11-21T01:20:11.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40822024-11-21T01:20:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40832024-11-21T01:20:11.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40842024-11-21T01:20:11.315ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40852024-11-21T01:20:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40862024-11-21T01:20:11.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40872024-11-21T01:20:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40882024-11-21T01:20:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40892024-11-21T01:20:11.318ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40902024-11-21T01:20:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40912024-11-21T01:20:11.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40922024-11-21T01:20:11.322ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40932024-11-21T01:20:11.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40942024-11-21T01:20:11.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40952024-11-21T01:20:11.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40962024-11-21T01:20:11.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40972024-11-21T01:20:11.325ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40982024-11-21T01:20:11.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40992024-11-21T01:20:11.331ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.790241ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
41002024-11-21T01:20:11.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41012024-11-21T01:20:11.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41022024-11-21T01:20:11.363ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41032024-11-21T01:20:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41042024-11-21T01:20:11.366ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41052024-11-21T01:20:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41062024-11-21T01:20:11.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41072024-11-21T01:20:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41082024-11-21T01:20:11.374ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41092024-11-21T01:20:11.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41102024-11-21T01:20:11.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41112024-11-21T01:20:11.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41122024-11-21T01:20:11.376ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41132024-11-21T01:20:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41142024-11-21T01:20:11.377ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41152024-11-21T01:20:11.377ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41162024-11-21T01:20:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41172024-11-21T01:20:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41182024-11-21T01:20:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41192024-11-21T01:20:11.379ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41202024-11-21T01:20:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41212024-11-21T01:20:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41222024-11-21T01:20:11.380ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41232024-11-21T01:20:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41242024-11-21T01:20:11.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41252024-11-21T01:20:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41262024-11-21T01:20:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41272024-11-21T01:20:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41282024-11-21T01:20:11.381ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41292024-11-21T01:20:11.381ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41302024-11-21T01:20:11.381ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41312024-11-21T01:20:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41322024-11-21T01:20:11.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41332024-11-21T01:20:11.382ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
41342024-11-21T01:20:11.382ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
41352024-11-21T01:20:11.382ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
41362024-11-21T01:20:11.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41372024-11-21T01:20:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41382024-11-21T01:20:11.383ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41392024-11-21T01:20:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41402024-11-21T01:20:11.384ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41412024-11-21T01:20:11.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41422024-11-21T01:20:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41432024-11-21T01:20:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41442024-11-21T01:20:11.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41452024-11-21T01:20:11.385ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41462024-11-21T01:20:11.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41472024-11-21T01:20:11.385ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41482024-11-21T01:20:11.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41492024-11-21T01:20:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41502024-11-21T01:20:11.387ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41512024-11-21T01:20:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41522024-11-21T01:20:11.388ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41532024-11-21T01:20:11.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41542024-11-21T01:20:11.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41552024-11-21T01:20:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41562024-11-21T01:20:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41572024-11-21T01:20:11.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41582024-11-21T01:20:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41592024-11-21T01:20:11.398ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41602024-11-21T01:20:11.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41612024-11-21T01:20:11.398ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1190, tv_nsec: 297858220 } })
41622024-11-21T01:20:11.399ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
41632024-11-21T01:20:11.400ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41642024-11-21T01:20:11.400ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41652024-11-21T01:20:11.400ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41662024-11-21T01:20:11.400ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 97.443583ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41672024-11-21T01:20:11.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41682024-11-21T01:20:11.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41692024-11-21T01:20:11.401ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41702024-11-21T01:20:11.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41712024-11-21T01:20:11.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41722024-11-21T01:20:11.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
41732024-11-21T01:20:11.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41742024-11-21T01:20:11.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41752024-11-21T01:20:11.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41762024-11-21T01:20:11.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41772024-11-21T01:20:11.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41782024-11-21T01:20:11.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 104.420982ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
41792024-11-21T01:20:11.408ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 107.208731ms iteration = 3 status = {"nsuccess":5}
41802024-11-21T01:20:11.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 106.665964ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
41812024-11-21T01:20:11.410ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41822024-11-21T01:20:11.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41832024-11-21T01:20:11.421ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
41842024-11-21T01:20:11.426ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41852024-11-21T01:20:11.426ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41862024-11-21T01:20:11.426ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41872024-11-21T01:20:11.426ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 125.020772ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41882024-11-21T01:20:11.428ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41892024-11-21T01:20:11.428ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41902024-11-21T01:20:11.428ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41912024-11-21T01:20:11.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41922024-11-21T01:20:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41932024-11-21T01:20:11.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942024-11-21T01:20:11.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41952024-11-21T01:20:11.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41962024-11-21T01:20:11.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41972024-11-21T01:20:11.438ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
41982024-11-21T01:20:11.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 137.439967ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
41992024-11-21T01:20:11.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
42002024-11-21T01:20:11.439ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42012024-11-21T01:20:11.439ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86e10078-e01c-4020-bf91-30711e0c46e0", "content-length": "26", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
42022024-11-21T01:20:11.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42032024-11-21T01:20:11.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 139.501616ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42042024-11-21T01:20:11.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42052024-11-21T01:20:11.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42062024-11-21T01:20:11.441ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42072024-11-21T01:20:11.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42082024-11-21T01:20:11.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 146.596516ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
42092024-11-21T01:20:11.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42102024-11-21T01:20:11.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42112024-11-21T01:20:11.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42122024-11-21T01:20:11.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 150.249918ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42132024-11-21T01:20:11.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42142024-11-21T01:20:11.455ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42152024-11-21T01:20:11.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42162024-11-21T01:20:11.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42172024-11-21T01:20:11.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42182024-11-21T01:20:11.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42192024-11-21T01:20:11.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42202024-11-21T01:20:11.458ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42212024-11-21T01:20:11.458ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 156.669648ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42222024-11-21T01:20:11.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42232024-11-21T01:20:11.462ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42242024-11-21T01:20:11.462ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42252024-11-21T01:20:11.462ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42262024-11-21T01:20:11.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42272024-11-21T01:20:11.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42282024-11-21T01:20:11.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42292024-11-21T01:20:11.466ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
42302024-11-21T01:20:11.466ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42312024-11-21T01:20:11.466ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "011871c9-90be-4558-8cc3-74ee6021cc5e", "content-length": "26", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
42322024-11-21T01:20:11.466ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42332024-11-21T01:20:11.469ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42342024-11-21T01:20:11.483ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42352024-11-21T01:20:11.483ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
42362024-11-21T01:20:11.483ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42372024-11-21T01:20:11.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42382024-11-21T01:20:11.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42392024-11-21T01:20:11.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42402024-11-21T01:20:11.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42412024-11-21T01:20:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42422024-11-21T01:20:11.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42432024-11-21T01:20:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
42442024-11-21T01:20:11.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42452024-11-21T01:20:11.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42462024-11-21T01:20:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42472024-11-21T01:20:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42482024-11-21T01:20:11.492ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
42492024-11-21T01:20:11.492ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 190.854709ms iteration = 7 status = 0
42502024-11-21T01:20:11.492ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42512024-11-21T01:20:11.492ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
42522024-11-21T01:20:11.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 190.990661ms iteration = 4 status = {"generation":2}
42532024-11-21T01:20:11.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 197.619375ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
42542024-11-21T01:20:11.502ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42552024-11-21T01:20:11.502ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42562024-11-21T01:20:11.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42572024-11-21T01:20:11.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42582024-11-21T01:20:11.503ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42592024-11-21T01:20:11.503ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
42602024-11-21T01:20:11.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 201.415858ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
42612024-11-21T01:20:11.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42622024-11-21T01:20:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42632024-11-21T01:20:11.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42642024-11-21T01:20:11.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42652024-11-21T01:20:11.512ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
42662024-11-21T01:20:11.512ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42672024-11-21T01:20:11.512ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
42682024-11-21T01:20:11.512ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 211.235417ms iteration = 4 status = {"generation":1}
42692024-11-21T01:20:11.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 808cc610-7eba-4f76-a043-ddcdc6130a11 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
42702024-11-21T01:20:11.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 808cc610-7eba-4f76-a043-ddcdc6130a11 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
42712024-11-21T01:20:11.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 808cc610-7eba-4f76-a043-ddcdc6130a11 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
42722024-11-21T01:20:11.528ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.497335ms iteration = 9 status = {"physical_disks_added":0}
42732024-11-21T01:20:11.531ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
42742024-11-21T01:20:11.531ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42752024-11-21T01:20:11.532ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3912e5cc-0a8e-4a17-bfa7-75ffd5978228", "content-length": "26", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
42762024-11-21T01:20:11.532ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42772024-11-21T01:20:11.533ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
42782024-11-21T01:20:11.547ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
42792024-11-21T01:20:11.547ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 245.53892ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42802024-11-21T01:20:11.575ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
42812024-11-21T01:20:11.575ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 273.750188ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42822024-11-21T01:20:11.592ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 291.173303ms iteration = 7 status = {}
42832024-11-21T01:20:11.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42842024-11-21T01:20:11.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42852024-11-21T01:20:11.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42862024-11-21T01:20:11.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42872024-11-21T01:20:11.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42882024-11-21T01:20:11.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42892024-11-21T01:20:11.609ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42902024-11-21T01:20:11.661ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42912024-11-21T01:20:11.661ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42922024-11-21T01:20:11.662ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a47c9458-eb03-4ee0-bd43-f7c325e021c2", "content-length": "372", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
42932024-11-21T01:20:11.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42942024-11-21T01:20:11.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42952024-11-21T01:20:11.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42962024-11-21T01:20:11.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42972024-11-21T01:20:11.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42982024-11-21T01:20:11.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42992024-11-21T01:20:11.679ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
43002024-11-21T01:20:11.679ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43012024-11-21T01:20:11.679ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "40e0ba49-8cd8-423d-9922-e79fbf958aba", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
43022024-11-21T01:20:11.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43032024-11-21T01:20:11.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43042024-11-21T01:20:11.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43052024-11-21T01:20:11.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43062024-11-21T01:20:11.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43072024-11-21T01:20:11.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43082024-11-21T01:20:11.688ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43092024-11-21T01:20:11.688ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43102024-11-21T01:20:11.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 725ee9a7-02f3-46fa-9556-e03904d86e83 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43112024-11-21T01:20:11.689ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0b76b70b-362e-44f0-9ef6-b14aecaa793c", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
43122024-11-21T01:20:11.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 725ee9a7-02f3-46fa-9556-e03904d86e83 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43132024-11-21T01:20:11.690ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 388.234621ms iteration = 7 status = {}
43142024-11-21T01:20:11.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 725ee9a7-02f3-46fa-9556-e03904d86e83 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43152024-11-21T01:20:11.691ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43162024-11-21T01:20:11.691ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "74a583f9-1061-4277-a945-6df8f0520c2e", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43172024-11-21T01:20:11.691ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43182024-11-21T01:20:11.693ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1e560ed6-f884-47c2-abea-3e3edb2020ff", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43192024-11-21T01:20:11.693ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43202024-11-21T01:20:11.694ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43212024-11-21T01:20:11.694ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 393.182191ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
43222024-11-21T01:20:11.704ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43232024-11-21T01:20:11.704ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "697e70ae-1fca-4684-8122-ee238cbddf68", "content-length": "1", "date": "Thu, 21 Nov 2024 01:20:10 GMT"} })
43242024-11-21T01:20:11.706ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43252024-11-21T01:20:11.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43262024-11-21T01:20:11.708ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 407.228089ms iteration = 7 status = null
43272024-11-21T01:20:11.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
43282024-11-21T01:20:11.720ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "193e9579-49b5-4b8b-86a9-634014c6fde9", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43292024-11-21T01:20:11.720ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43302024-11-21T01:20:11.722ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "739ddb60-2b5e-42d1-a670-13e88014b48c", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43312024-11-21T01:20:11.722ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43322024-11-21T01:20:11.724ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d301538c-45b3-4ec8-9da7-77bd68dd2cf8", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43332024-11-21T01:20:11.724ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43342024-11-21T01:20:11.726ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
43352024-11-21T01:20:11.726ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 424.755615ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
43362024-11-21T01:20:11.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43372024-11-21T01:20:11.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43382024-11-21T01:20:11.767ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
43392024-11-21T01:20:11.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43402024-11-21T01:20:11.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43412024-11-21T01:20:11.777ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43422024-11-21T01:20:11.778ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e77ebe14-db09-4c51-b230-71a9921f383c", "content-length": "134", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
43432024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43442024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
43452024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43462024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43472024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43482024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43492024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43502024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43512024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43522024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43532024-11-21T01:20:11.778ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
43542024-11-21T01:20:11.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43552024-11-21T01:20:11.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43562024-11-21T01:20:11.781ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43572024-11-21T01:20:11.781ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5fe5117-97ab-4839-8a30-4a351714319c", "content-length": "2", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
43582024-11-21T01:20:11.781ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43592024-11-21T01:20:11.781ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d82c1e00-354e-4dc2-a491-7754f50a1b64", "content-length": "51", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
43602024-11-21T01:20:11.781ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
43612024-11-21T01:20:11.781ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43622024-11-21T01:20:11.797ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43632024-11-21T01:20:11.878ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2b4146b2-a661-4bfe-9753-642f619b51d4", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
43642024-11-21T01:20:11.878ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
43652024-11-21T01:20:11.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43662024-11-21T01:20:11.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b178e03b-47a1-4053-8d7e-5f89f96bddcb", "content-length": "691", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
43672024-11-21T01:20:11.879ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
43682024-11-21T01:20:11.879ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
43692024-11-21T01:20:11.879ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
43702024-11-21T01:20:11.879ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3def1b7f-4694-4bf5-8147-d40a0c5480d7", "content-length": "682", "date": "Thu, 21 Nov 2024 01:20:11 GMT"} })
43712024-11-21T01:20:11.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43722024-11-21T01:20:11.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43732024-11-21T01:20:11.880ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 579.331504ms iteration = 7 status = {}
43742024-11-21T01:20:11.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43752024-11-21T01:20:11.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43762024-11-21T01:20:11.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43772024-11-21T01:20:11.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43782024-11-21T01:20:11.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43792024-11-21T01:20:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43802024-11-21T01:20:11.896ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 595.41028ms iteration = 7 status = {}
43812024-11-21T01:20:12.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa08d2ee-cdbd-4b7b-b039-a7ccd0f1ceb3 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43822024-11-21T01:20:12.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa08d2ee-cdbd-4b7b-b039-a7ccd0f1ceb3 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43832024-11-21T01:20:12.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa08d2ee-cdbd-4b7b-b039-a7ccd0f1ceb3 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43842024-11-21T01:20:13.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 79e1372e-eb7b-4398-8a88-4d03a27b54f5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43852024-11-21T01:20:13.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 79e1372e-eb7b-4398-8a88-4d03a27b54f5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43862024-11-21T01:20:13.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 79e1372e-eb7b-4398-8a88-4d03a27b54f5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43872024-11-21T01:20:14.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af6ea20a-c3a6-4535-826b-efaa16e5385c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43882024-11-21T01:20:14.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af6ea20a-c3a6-4535-826b-efaa16e5385c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43892024-11-21T01:20:14.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af6ea20a-c3a6-4535-826b-efaa16e5385c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43902024-11-21T01:20:15.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = be477e76-eeea-4258-b1d2-e9394382807d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43912024-11-21T01:20:15.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = be477e76-eeea-4258-b1d2-e9394382807d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43922024-11-21T01:20:15.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = be477e76-eeea-4258-b1d2-e9394382807d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43932024-11-21T01:20:16.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdabd5ed-7612-47b8-938c-3cf58b37a48e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43942024-11-21T01:20:16.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdabd5ed-7612-47b8-938c-3cf58b37a48e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43952024-11-21T01:20:16.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdabd5ed-7612-47b8-938c-3cf58b37a48e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43962024-11-21T01:20:17.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e7a8b54-0b32-48bd-83af-118d61e5c33a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43972024-11-21T01:20:17.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e7a8b54-0b32-48bd-83af-118d61e5c33a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43982024-11-21T01:20:17.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e7a8b54-0b32-48bd-83af-118d61e5c33a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
43992024-11-21T01:20:18.486ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 841 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = d2d5b25e-7a13-483e-9862-22b1cfbf12f6 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
44002024-11-21T01:20:18.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bbb4809-ec7a-4741-af25-13825054f8fb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44012024-11-21T01:20:18.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bbb4809-ec7a-4741-af25-13825054f8fb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44022024-11-21T01:20:18.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bbb4809-ec7a-4741-af25-13825054f8fb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44032024-11-21T01:20:19.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 828390a2-8982-4c3d-b7c3-7705d4aa1e8a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44042024-11-21T01:20:19.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 828390a2-8982-4c3d-b7c3-7705d4aa1e8a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44052024-11-21T01:20:19.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 828390a2-8982-4c3d-b7c3-7705d4aa1e8a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44062024-11-21T01:20:20.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0bbe2101-3ae8-48d6-83ea-fc67cf79271b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44072024-11-21T01:20:20.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0bbe2101-3ae8-48d6-83ea-fc67cf79271b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44082024-11-21T01:20:20.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0bbe2101-3ae8-48d6-83ea-fc67cf79271b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44092024-11-21T01:20:21.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
44102024-11-21T01:20:21.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44112024-11-21T01:20:21.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44122024-11-21T01:20:21.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
44132024-11-21T01:20:21.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44142024-11-21T01:20:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44152024-11-21T01:20:21.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44162024-11-21T01:20:21.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44172024-11-21T01:20:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44182024-11-21T01:20:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44192024-11-21T01:20:21.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44202024-11-21T01:20:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44212024-11-21T01:20:21.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44222024-11-21T01:20:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44232024-11-21T01:20:21.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44242024-11-21T01:20:21.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
44252024-11-21T01:20:21.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44262024-11-21T01:20:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44272024-11-21T01:20:21.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
44282024-11-21T01:20:21.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.772641ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
44292024-11-21T01:20:21.333ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.775084ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44302024-11-21T01:20:21.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0f024041-f6fb-4db3-8903-653caa6c4f58 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44312024-11-21T01:20:21.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0f024041-f6fb-4db3-8903-653caa6c4f58 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44322024-11-21T01:20:21.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0f024041-f6fb-4db3-8903-653caa6c4f58 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44332024-11-21T01:20:22.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = de6d3a14-fa78-46f1-ae51-a9c24ba79fd6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44342024-11-21T01:20:22.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = de6d3a14-fa78-46f1-ae51-a9c24ba79fd6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44352024-11-21T01:20:22.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = de6d3a14-fa78-46f1-ae51-a9c24ba79fd6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44362024-11-21T01:20:23.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c3dcdbd-d1c1-41c8-bbc0-48e610b9fda9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44372024-11-21T01:20:23.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c3dcdbd-d1c1-41c8-bbc0-48e610b9fda9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44382024-11-21T01:20:23.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c3dcdbd-d1c1-41c8-bbc0-48e610b9fda9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44392024-11-21T01:20:24.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 26df3217-5a30-4b73-a241-3acf258d41b1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44402024-11-21T01:20:24.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 26df3217-5a30-4b73-a241-3acf258d41b1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44412024-11-21T01:20:24.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 26df3217-5a30-4b73-a241-3acf258d41b1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44422024-11-21T01:20:25.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a22a058b-6ba8-4982-8c84-9fce816d9c8c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44432024-11-21T01:20:25.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a22a058b-6ba8-4982-8c84-9fce816d9c8c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44442024-11-21T01:20:25.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a22a058b-6ba8-4982-8c84-9fce816d9c8c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44452024-11-21T01:20:27.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4bdfafe9-b686-492f-bd4d-86daaa75629b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44462024-11-21T01:20:27.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4bdfafe9-b686-492f-bd4d-86daaa75629b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44472024-11-21T01:20:27.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4bdfafe9-b686-492f-bd4d-86daaa75629b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44482024-11-21T01:20:28.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eedaa79b-d2ad-4d75-b509-2400dad1fc49 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44492024-11-21T01:20:28.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eedaa79b-d2ad-4d75-b509-2400dad1fc49 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44502024-11-21T01:20:28.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eedaa79b-d2ad-4d75-b509-2400dad1fc49 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44512024-11-21T01:20:29.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ac40446-8e9c-4105-a961-201aa5659e91 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44522024-11-21T01:20:29.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ac40446-8e9c-4105-a961-201aa5659e91 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44532024-11-21T01:20:29.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ac40446-8e9c-4105-a961-201aa5659e91 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44542024-11-21T01:20:30.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = abcae419-8f62-4af9-b8c9-13fbc3fd81e8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44552024-11-21T01:20:30.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = abcae419-8f62-4af9-b8c9-13fbc3fd81e8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44562024-11-21T01:20:30.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = abcae419-8f62-4af9-b8c9-13fbc3fd81e8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44572024-11-21T01:20:31.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1103a9d4-f4fb-4b80-b78a-a6fbcdbfce4b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44582024-11-21T01:20:31.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1103a9d4-f4fb-4b80-b78a-a6fbcdbfce4b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44592024-11-21T01:20:31.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1103a9d4-f4fb-4b80-b78a-a6fbcdbfce4b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44602024-11-21T01:20:31.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
44612024-11-21T01:20:31.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44622024-11-21T01:20:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44632024-11-21T01:20:31.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
44642024-11-21T01:20:31.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44652024-11-21T01:20:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44662024-11-21T01:20:31.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44672024-11-21T01:20:31.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44682024-11-21T01:20:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44692024-11-21T01:20:31.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.445358ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44702024-11-21T01:20:31.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44712024-11-21T01:20:31.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44722024-11-21T01:20:31.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44732024-11-21T01:20:31.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44742024-11-21T01:20:31.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44752024-11-21T01:20:31.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44762024-11-21T01:20:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
44772024-11-21T01:20:31.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44782024-11-21T01:20:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44792024-11-21T01:20:31.322ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
44802024-11-21T01:20:31.322ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.743602ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
44812024-11-21T01:20:32.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5f92cbb9-2b72-410d-86e4-38fac5eddfa7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44822024-11-21T01:20:32.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5f92cbb9-2b72-410d-86e4-38fac5eddfa7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44832024-11-21T01:20:32.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5f92cbb9-2b72-410d-86e4-38fac5eddfa7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44842024-11-21T01:20:33.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8700d8b7-3ceb-4b9a-b961-93682983a26c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44852024-11-21T01:20:33.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8700d8b7-3ceb-4b9a-b961-93682983a26c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44862024-11-21T01:20:33.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8700d8b7-3ceb-4b9a-b961-93682983a26c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44872024-11-21T01:20:33.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 906 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 5e41257a-cdbc-457d-8ebe-2bb1b75a9d63 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
44882024-11-21T01:20:34.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e7f8d99-9d14-4f81-821a-5ac2a3dd67f8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44892024-11-21T01:20:34.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e7f8d99-9d14-4f81-821a-5ac2a3dd67f8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44902024-11-21T01:20:34.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e7f8d99-9d14-4f81-821a-5ac2a3dd67f8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44912024-11-21T01:20:35.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b02df4ac-21c8-458a-9e24-dcc71681b0b8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44922024-11-21T01:20:35.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b02df4ac-21c8-458a-9e24-dcc71681b0b8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44932024-11-21T01:20:35.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b02df4ac-21c8-458a-9e24-dcc71681b0b8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44942024-11-21T01:20:36.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0146fa79-0157-4e72-a565-c4798da21cea roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44952024-11-21T01:20:36.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0146fa79-0157-4e72-a565-c4798da21cea resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44962024-11-21T01:20:36.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0146fa79-0157-4e72-a565-c4798da21cea response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44972024-11-21T01:20:37.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9a13df56-049f-43e0-a2ef-8e7d62a47983 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44982024-11-21T01:20:37.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9a13df56-049f-43e0-a2ef-8e7d62a47983 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
44992024-11-21T01:20:37.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9a13df56-049f-43e0-a2ef-8e7d62a47983 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45002024-11-21T01:20:38.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc604a7a-1dcb-4543-9a09-13007317e530 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45012024-11-21T01:20:38.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc604a7a-1dcb-4543-9a09-13007317e530 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45022024-11-21T01:20:38.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc604a7a-1dcb-4543-9a09-13007317e530 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45032024-11-21T01:20:39.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19a98e94-b471-4e87-94b6-0eb41a1d353b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45042024-11-21T01:20:39.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19a98e94-b471-4e87-94b6-0eb41a1d353b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45052024-11-21T01:20:39.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19a98e94-b471-4e87-94b6-0eb41a1d353b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45062024-11-21T01:20:40.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5997f5df-8ea0-4b7e-9ed9-13585c5f9ec9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45072024-11-21T01:20:40.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5997f5df-8ea0-4b7e-9ed9-13585c5f9ec9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45082024-11-21T01:20:40.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5997f5df-8ea0-4b7e-9ed9-13585c5f9ec9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
45092024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
45102024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45112024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
45122024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
45132024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45142024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45152024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
45162024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
45172024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45182024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45192024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
45202024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
45212024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45222024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
45232024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45242024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
45252024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45262024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45272024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45282024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45292024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45302024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45312024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45322024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45332024-11-21T01:20:41.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45342024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
45352024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
45362024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45372024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45382024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45392024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
45402024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45412024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
45422024-11-21T01:20:41.302ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45432024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45442024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45452024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45462024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45472024-11-21T01:20:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45482024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
45492024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45502024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
45512024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45522024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
45532024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45542024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
45552024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45562024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45572024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45582024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45592024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45602024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45612024-11-21T01:20:41.303ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.489096ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45622024-11-21T01:20:41.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45632024-11-21T01:20:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45642024-11-21T01:20:41.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45652024-11-21T01:20:41.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1220, tv_nsec: 204711298 } })
45662024-11-21T01:20:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45672024-11-21T01:20:41.306ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
45682024-11-21T01:20:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45692024-11-21T01:20:41.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45702024-11-21T01:20:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45712024-11-21T01:20:41.306ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1220, tv_nsec: 205671821 } })
45722024-11-21T01:20:41.307ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
45732024-11-21T01:20:41.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45742024-11-21T01:20:41.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45752024-11-21T01:20:41.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45762024-11-21T01:20:41.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45772024-11-21T01:20:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45782024-11-21T01:20:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45792024-11-21T01:20:41.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45802024-11-21T01:20:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45812024-11-21T01:20:41.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45822024-11-21T01:20:41.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45832024-11-21T01:20:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45842024-11-21T01:20:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45852024-11-21T01:20:41.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45862024-11-21T01:20:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45872024-11-21T01:20:41.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45882024-11-21T01:20:41.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45892024-11-21T01:20:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45902024-11-21T01:20:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45912024-11-21T01:20:41.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45922024-11-21T01:20:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45932024-11-21T01:20:41.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1220, tv_nsec: 215583131 } })
45942024-11-21T01:20:41.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
45952024-11-21T01:20:41.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45962024-11-21T01:20:41.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45972024-11-21T01:20:41.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45982024-11-21T01:20:41.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45992024-11-21T01:20:41.317ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46002024-11-21T01:20:41.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46012024-11-21T01:20:41.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46022024-11-21T01:20:41.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46032024-11-21T01:20:41.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46042024-11-21T01:20:41.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46052024-11-21T01:20:41.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46062024-11-21T01:20:41.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46072024-11-21T01:20:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46082024-11-21T01:20:41.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46092024-11-21T01:20:41.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46102024-11-21T01:20:41.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46112024-11-21T01:20:41.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46122024-11-21T01:20:41.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
46132024-11-21T01:20:41.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46142024-11-21T01:20:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46152024-11-21T01:20:41.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bbbed78e-18a1-4cc9-9f1c-68a67e5c45f8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
46162024-11-21T01:20:41.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bbbed78e-18a1-4cc9-9f1c-68a67e5c45f8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
46172024-11-21T01:20:41.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bbbed78e-18a1-4cc9-9f1c-68a67e5c45f8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
46182024-11-21T01:20:41.342ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
46192024-11-21T01:20:41.342ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.246751ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
46202024-11-21T01:20:41.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.804078ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
46212024-11-21T01:20:41.353ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46222024-11-21T01:20:41.353ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46232024-11-21T01:20:41.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46242024-11-21T01:20:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46252024-11-21T01:20:41.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46262024-11-21T01:20:41.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46272024-11-21T01:20:41.356ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46282024-11-21T01:20:41.356ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46292024-11-21T01:20:41.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46302024-11-21T01:20:41.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46312024-11-21T01:20:41.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.723331ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46322024-11-21T01:20:41.358ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46332024-11-21T01:20:41.358ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46342024-11-21T01:20:41.358ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 56.305993ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46352024-11-21T01:20:41.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.804961ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46362024-11-21T01:20:41.364ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46372024-11-21T01:20:41.364ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.162856ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46382024-11-21T01:20:41.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.694829ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
46392024-11-21T01:20:41.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.049373ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46402024-11-21T01:20:41.372ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 70.761847ms iteration = 10 status = {"physical_disks_added":0}
46412024-11-21T01:20:41.389ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46422024-11-21T01:20:41.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46432024-11-21T01:20:41.400ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
46442024-11-21T01:20:41.400ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46452024-11-21T01:20:41.400ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67bb5f03-fa7c-4528-aef7-fa829f011b3e", "content-length": "26", "date": "Thu, 21 Nov 2024 01:20:41 GMT"} })
46462024-11-21T01:20:41.400ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46472024-11-21T01:20:41.401ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46482024-11-21T01:20:41.410ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
46492024-11-21T01:20:41.410ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46502024-11-21T01:20:41.410ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e69142d-4d02-4f61-9323-e0040ebf4ab4", "content-length": "26", "date": "Thu, 21 Nov 2024 01:20:41 GMT"} })
46512024-11-21T01:20:41.410ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46522024-11-21T01:20:41.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46532024-11-21T01:20:41.412ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46542024-11-21T01:20:41.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46552024-11-21T01:20:41.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46562024-11-21T01:20:41.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.170023ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46572024-11-21T01:20:41.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46582024-11-21T01:20:41.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46592024-11-21T01:20:41.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46602024-11-21T01:20:41.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46612024-11-21T01:20:41.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46622024-11-21T01:20:41.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46632024-11-21T01:20:41.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46642024-11-21T01:20:41.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46652024-11-21T01:20:41.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46662024-11-21T01:20:41.458ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
46672024-11-21T01:20:41.458ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46682024-11-21T01:20:41.458ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8764b131-3c02-4620-93f6-446d7b8005ce", "content-length": "26", "date": "Thu, 21 Nov 2024 01:20:41 GMT"} })
46692024-11-21T01:20:41.458ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46702024-11-21T01:20:41.460ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
46712024-11-21T01:20:41.525ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46722024-11-21T01:20:41.525ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "65ae4b5c-ca57-4898-8936-d69cf9124aa9", "content-length": "1", "date": "Thu, 21 Nov 2024 01:20:40 GMT"} })
46732024-11-21T01:20:41.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46742024-11-21T01:20:41.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46752024-11-21T01:20:41.536ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.60627ms iteration = 8 status = {}
46762024-11-21T01:20:41.539ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46772024-11-21T01:20:41.540ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46782024-11-21T01:20:41.541ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a871fbb9-a179-4a24-8a9e-b5ff78ce54e3", "content-length": "372", "date": "Thu, 21 Nov 2024 01:20:40 GMT"} })
46792024-11-21T01:20:41.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46802024-11-21T01:20:41.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46812024-11-21T01:20:41.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-11-21T01:20:41.542ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 241.365222ms iteration = 8 status = null
46832024-11-21T01:20:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
46842024-11-21T01:20:41.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46852024-11-21T01:20:41.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46862024-11-21T01:20:41.546ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 244.636307ms iteration = 8 status = 0
46872024-11-21T01:20:41.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 3c006530-5f03-4636-be42-5633d4c76345 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46882024-11-21T01:20:41.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 3c006530-5f03-4636-be42-5633d4c76345 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46892024-11-21T01:20:41.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 3c006530-5f03-4636-be42-5633d4c76345 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46902024-11-21T01:20:41.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46912024-11-21T01:20:41.568ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46922024-11-21T01:20:41.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46932024-11-21T01:20:41.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46942024-11-21T01:20:41.590ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46952024-11-21T01:20:41.590ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46962024-11-21T01:20:41.590ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4192328e-fd0c-4627-8809-a342638138bb", "date": "Thu, 21 Nov 2024 01:20:40 GMT"} })
46972024-11-21T01:20:41.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46982024-11-21T01:20:41.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46992024-11-21T01:20:41.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47002024-11-21T01:20:41.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47012024-11-21T01:20:41.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47022024-11-21T01:20:41.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47032024-11-21T01:20:41.631ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47042024-11-21T01:20:41.632ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "63facd99-0d8a-40c3-9a68-c7d2401a9974", "content-length": "691", "date": "Thu, 21 Nov 2024 01:20:40 GMT"} })
47052024-11-21T01:20:41.632ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
47062024-11-21T01:20:41.632ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
47072024-11-21T01:20:41.632ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
47082024-11-21T01:20:41.633ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 332.480766ms iteration = 8 status = {}
47092024-11-21T01:20:41.634ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47102024-11-21T01:20:41.634ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47112024-11-21T01:20:41.635ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b4a717a3-c7c5-47fc-a09f-db46be4b0f00", "date": "Thu, 21 Nov 2024 01:20:40 GMT"} })
47122024-11-21T01:20:41.637ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.460403ms iteration = 8 status = {}
47132024-11-21T01:20:41.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47142024-11-21T01:20:41.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47152024-11-21T01:20:41.646ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
47162024-11-21T01:20:41.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47172024-11-21T01:20:41.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47182024-11-21T01:20:41.656ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47192024-11-21T01:20:41.656ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "13bec7d6-c6ba-4a20-a16c-bf722cdd79aa", "content-length": "134", "date": "Thu, 21 Nov 2024 01:20:40 GMT"} })
47202024-11-21T01:20:41.656ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47212024-11-21T01:20:41.656ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
47222024-11-21T01:20:41.656ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47232024-11-21T01:20:41.656ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47242024-11-21T01:20:41.656ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47252024-11-21T01:20:41.656ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47262024-11-21T01:20:41.656ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47272024-11-21T01:20:41.656ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47282024-11-21T01:20:41.657ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47292024-11-21T01:20:41.657ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47302024-11-21T01:20:41.657ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
47312024-11-21T01:20:41.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47322024-11-21T01:20:41.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47332024-11-21T01:20:41.659ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47342024-11-21T01:20:41.659ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a9635fb-3b92-4547-a5bc-3bfc779e783e", "content-length": "2", "date": "Thu, 21 Nov 2024 01:20:40 GMT"} })
47352024-11-21T01:20:41.659ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47362024-11-21T01:20:41.659ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "670b98e4-b5a6-4a5a-801a-38a5dd5812a9", "content-length": "51", "date": "Thu, 21 Nov 2024 01:20:40 GMT"} })
47372024-11-21T01:20:41.659ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
47382024-11-21T01:20:41.659ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47392024-11-21T01:20:41.738ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
47402024-11-21T01:20:41.738ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
47412024-11-21T01:20:41.770ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
47422024-11-21T01:20:41.770ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:34562
47432024-11-21T01:20:41.770ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f500a06a-0270-4764-9fd6-fb6715ea9db3", "date": "Thu, 21 Nov 2024 01:20:41 GMT"} })
47442024-11-21T01:20:41.770ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
47452024-11-21T01:20:41.770ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47462024-11-21T01:20:41.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34562 req_id = 2d15451f-71bc-46d4-bf14-c6112c9b921d roles = RoleSet { roles: {} } uri = /metrics/producers
47472024-11-21T01:20:41.771ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eff97c0f-2a2c-4260-9df6-52c9fdfb5ed7", "content-length": "682", "date": "Thu, 21 Nov 2024 01:20:41 GMT"} })
47482024-11-21T01:20:41.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47492024-11-21T01:20:41.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34562 req_id = 2d15451f-71bc-46d4-bf14-c6112c9b921d resource = Database result = Ok(()) uri = /metrics/producers
47502024-11-21T01:20:41.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47512024-11-21T01:20:41.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47522024-11-21T01:20:41.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47532024-11-21T01:20:41.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47542024-11-21T01:20:41.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47552024-11-21T01:20:41.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47562024-11-21T01:20:41.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47572024-11-21T01:20:41.786ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 485.128246ms iteration = 8 status = {}
47582024-11-21T01:20:41.807ZINFOnexus: assigned collector to new producer collector_id = 49435a09-4a28-49d2-bf6d-81a21cb92fe2 file = nexus/src/app/oximeter.rs:76 producer_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
47592024-11-21T01:20:41.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36681 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:34562 req_id = 2d15451f-71bc-46d4-bf14-c6112c9b921d response_code = 201 uri = /metrics/producers
47602024-11-21T01:20:41.807ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2d15451f-71bc-46d4-bf14-c6112c9b921d", "content-length": "41", "date": "Thu, 21 Nov 2024 01:20:41 GMT"} })
47612024-11-21T01:20:41.808ZDEBGnexus (producer-registration-task): registered with nexus successfully
47622024-11-21T01:20:41.808ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
47632024-11-21T01:20:42.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5ce0ad7-990a-480e-86be-eaf2cbd4341b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47642024-11-21T01:20:42.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5ce0ad7-990a-480e-86be-eaf2cbd4341b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47652024-11-21T01:20:42.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5ce0ad7-990a-480e-86be-eaf2cbd4341b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47662024-11-21T01:20:43.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed087190-873c-4984-bda5-1504d32ae530 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47672024-11-21T01:20:43.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed087190-873c-4984-bda5-1504d32ae530 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47682024-11-21T01:20:43.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed087190-873c-4984-bda5-1504d32ae530 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47692024-11-21T01:20:44.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 742b2485-d54f-45e1-9f21-6eaa91c0f1a8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47702024-11-21T01:20:44.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 742b2485-d54f-45e1-9f21-6eaa91c0f1a8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47712024-11-21T01:20:44.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 742b2485-d54f-45e1-9f21-6eaa91c0f1a8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47722024-11-21T01:20:45.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bccaab13-3dbf-49bd-befb-7d497440637d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47732024-11-21T01:20:45.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bccaab13-3dbf-49bd-befb-7d497440637d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47742024-11-21T01:20:45.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bccaab13-3dbf-49bd-befb-7d497440637d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47752024-11-21T01:20:46.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8830d5a4-9ed7-4547-b1d1-376ba1176620 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47762024-11-21T01:20:46.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8830d5a4-9ed7-4547-b1d1-376ba1176620 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47772024-11-21T01:20:46.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8830d5a4-9ed7-4547-b1d1-376ba1176620 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47782024-11-21T01:20:47.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8da3d2e5-232d-4b15-b935-47266c93f7fd roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47792024-11-21T01:20:47.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8da3d2e5-232d-4b15-b935-47266c93f7fd resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47802024-11-21T01:20:47.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8da3d2e5-232d-4b15-b935-47266c93f7fd response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47812024-11-21T01:20:48.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce9ac490-562b-49b2-b05a-4f09023e40a9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47822024-11-21T01:20:48.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce9ac490-562b-49b2-b05a-4f09023e40a9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47832024-11-21T01:20:48.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce9ac490-562b-49b2-b05a-4f09023e40a9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47842024-11-21T01:20:48.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 579 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 806970a0-9a2c-41c5-b170-9a45f4424583 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
47852024-11-21T01:20:49.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51662b91-dcc3-4458-8b3e-a37d2960505c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47862024-11-21T01:20:49.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51662b91-dcc3-4458-8b3e-a37d2960505c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47872024-11-21T01:20:49.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51662b91-dcc3-4458-8b3e-a37d2960505c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47882024-11-21T01:20:50.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0a674501-3f1b-48b9-b577-4844e8b08fd3 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47892024-11-21T01:20:50.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0a674501-3f1b-48b9-b577-4844e8b08fd3 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47902024-11-21T01:20:50.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0a674501-3f1b-48b9-b577-4844e8b08fd3 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
47912024-11-21T01:20:51.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
47922024-11-21T01:20:51.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47932024-11-21T01:20:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47942024-11-21T01:20:51.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
47952024-11-21T01:20:51.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47962024-11-21T01:20:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47972024-11-21T01:20:51.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47982024-11-21T01:20:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47992024-11-21T01:20:51.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48002024-11-21T01:20:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48012024-11-21T01:20:51.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48022024-11-21T01:20:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48032024-11-21T01:20:51.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48042024-11-21T01:20:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
48052024-11-21T01:20:51.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48062024-11-21T01:20:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48072024-11-21T01:20:51.326ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
48082024-11-21T01:20:51.326ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.861726ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
48092024-11-21T01:20:51.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48102024-11-21T01:20:51.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48112024-11-21T01:20:51.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.177409ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48122024-11-21T01:20:51.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52bca481-b737-4e62-a133-480056f64cb2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48132024-11-21T01:20:51.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52bca481-b737-4e62-a133-480056f64cb2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48142024-11-21T01:20:51.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52bca481-b737-4e62-a133-480056f64cb2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48152024-11-21T01:20:52.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 088484bb-16fe-4903-808c-b3ad0da33829 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48162024-11-21T01:20:52.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 088484bb-16fe-4903-808c-b3ad0da33829 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48172024-11-21T01:20:52.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 088484bb-16fe-4903-808c-b3ad0da33829 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48182024-11-21T01:20:53.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f9a96071-1c5f-4e3c-8ae6-b4d607d7d65b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48192024-11-21T01:20:53.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f9a96071-1c5f-4e3c-8ae6-b4d607d7d65b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48202024-11-21T01:20:53.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f9a96071-1c5f-4e3c-8ae6-b4d607d7d65b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48212024-11-21T01:20:54.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 929c4212-f7a2-4547-a779-0bf983b5d1e5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48222024-11-21T01:20:54.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 929c4212-f7a2-4547-a779-0bf983b5d1e5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48232024-11-21T01:20:54.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 929c4212-f7a2-4547-a779-0bf983b5d1e5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48242024-11-21T01:20:55.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0348b1f1-922f-4604-a0a9-ea756b763e0c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48252024-11-21T01:20:55.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0348b1f1-922f-4604-a0a9-ea756b763e0c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48262024-11-21T01:20:55.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0348b1f1-922f-4604-a0a9-ea756b763e0c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48272024-11-21T01:20:56.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e04e9c8-0e41-4e4c-b23a-2e7ab8fcf331 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48282024-11-21T01:20:56.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e04e9c8-0e41-4e4c-b23a-2e7ab8fcf331 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48292024-11-21T01:20:56.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e04e9c8-0e41-4e4c-b23a-2e7ab8fcf331 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48302024-11-21T01:20:57.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 718d5ea8-e3f1-4055-a704-56eae8682b33 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48312024-11-21T01:20:57.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 718d5ea8-e3f1-4055-a704-56eae8682b33 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48322024-11-21T01:20:57.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 718d5ea8-e3f1-4055-a704-56eae8682b33 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48332024-11-21T01:20:58.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6ea0617e-2908-45ab-8734-49286c6095be roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48342024-11-21T01:20:58.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6ea0617e-2908-45ab-8734-49286c6095be resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48352024-11-21T01:20:58.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6ea0617e-2908-45ab-8734-49286c6095be response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48362024-11-21T01:20:59.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9efa8751-db11-485f-aa50-2180b60cb800 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48372024-11-21T01:20:59.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9efa8751-db11-485f-aa50-2180b60cb800 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48382024-11-21T01:20:59.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9efa8751-db11-485f-aa50-2180b60cb800 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48392024-11-21T01:21:00.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 96f96157-b7f0-4d52-ad6b-e28de1d8cb96 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48402024-11-21T01:21:00.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 96f96157-b7f0-4d52-ad6b-e28de1d8cb96 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48412024-11-21T01:21:00.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 96f96157-b7f0-4d52-ad6b-e28de1d8cb96 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48422024-11-21T01:21:01.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
48432024-11-21T01:21:01.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48442024-11-21T01:21:01.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48452024-11-21T01:21:01.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
48462024-11-21T01:21:01.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48472024-11-21T01:21:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48482024-11-21T01:21:01.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48492024-11-21T01:21:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48502024-11-21T01:21:01.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48512024-11-21T01:21:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48522024-11-21T01:21:01.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48532024-11-21T01:21:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48542024-11-21T01:21:01.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48552024-11-21T01:21:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
48562024-11-21T01:21:01.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48572024-11-21T01:21:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48582024-11-21T01:21:01.322ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
48592024-11-21T01:21:01.322ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.978906ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
48602024-11-21T01:21:01.335ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48612024-11-21T01:21:01.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48622024-11-21T01:21:01.337ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.037264ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48632024-11-21T01:21:01.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0d42eebe-e3d3-4ef7-86a3-233eb84a686b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48642024-11-21T01:21:01.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0d42eebe-e3d3-4ef7-86a3-233eb84a686b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48652024-11-21T01:21:01.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0d42eebe-e3d3-4ef7-86a3-233eb84a686b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48662024-11-21T01:21:02.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1c419807-6a91-44e3-b7c5-5fa331883a0b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48672024-11-21T01:21:02.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1c419807-6a91-44e3-b7c5-5fa331883a0b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48682024-11-21T01:21:02.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1c419807-6a91-44e3-b7c5-5fa331883a0b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48692024-11-21T01:21:03.486ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 639 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 131b1b29-967a-41b7-b762-335cbefa8221 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
48702024-11-21T01:21:03.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a9a8ab05-00a2-4de1-8bc2-839e071a3bdb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48712024-11-21T01:21:03.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a9a8ab05-00a2-4de1-8bc2-839e071a3bdb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48722024-11-21T01:21:03.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a9a8ab05-00a2-4de1-8bc2-839e071a3bdb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48732024-11-21T01:21:04.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1eaa8e2-9191-489d-9779-9be793773c37 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48742024-11-21T01:21:04.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1eaa8e2-9191-489d-9779-9be793773c37 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48752024-11-21T01:21:04.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1eaa8e2-9191-489d-9779-9be793773c37 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48762024-11-21T01:21:05.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 33abdd8c-53b9-4f8c-8d1b-ac609ca4679d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48772024-11-21T01:21:05.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 33abdd8c-53b9-4f8c-8d1b-ac609ca4679d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48782024-11-21T01:21:05.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 33abdd8c-53b9-4f8c-8d1b-ac609ca4679d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48792024-11-21T01:21:06.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01ddc433-9310-4678-8730-0403f2ac0d29 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48802024-11-21T01:21:06.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01ddc433-9310-4678-8730-0403f2ac0d29 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48812024-11-21T01:21:06.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01ddc433-9310-4678-8730-0403f2ac0d29 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48822024-11-21T01:21:07.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = df214aea-67c5-484c-ac9c-8f230b721685 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48832024-11-21T01:21:07.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = df214aea-67c5-484c-ac9c-8f230b721685 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48842024-11-21T01:21:07.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = df214aea-67c5-484c-ac9c-8f230b721685 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48852024-11-21T01:21:08.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 358bced0-d88f-4c62-bf4b-fae2b725477f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48862024-11-21T01:21:08.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 358bced0-d88f-4c62-bf4b-fae2b725477f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48872024-11-21T01:21:08.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 358bced0-d88f-4c62-bf4b-fae2b725477f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48882024-11-21T01:21:09.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51a1f782-477c-4603-aeea-b310928f4823 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48892024-11-21T01:21:09.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51a1f782-477c-4603-aeea-b310928f4823 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48902024-11-21T01:21:09.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51a1f782-477c-4603-aeea-b310928f4823 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48912024-11-21T01:21:10.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 268589a5-0598-4856-8199-cd87c6638092 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48922024-11-21T01:21:10.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 268589a5-0598-4856-8199-cd87c6638092 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48932024-11-21T01:21:10.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 268589a5-0598-4856-8199-cd87c6638092 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
48942024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
48952024-11-21T01:21:11.301ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
48962024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.831\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
48972024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
48982024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
48992024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49002024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
49012024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
49022024-11-21T01:21:11.301ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:11:11.301590347 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49032024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
49042024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49052024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49062024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
49072024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
49082024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
49092024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49102024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
49112024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49122024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49132024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
49142024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
49152024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49162024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49172024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
49182024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
49192024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
49202024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49212024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
49222024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
49232024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49242024-11-21T01:21:11.301ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49252024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
49262024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49272024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49282024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
49292024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
49302024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49312024-11-21T01:21:11.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49322024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49332024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49342024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49352024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49362024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49372024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49382024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49392024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49402024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49412024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49422024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49432024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49442024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49452024-11-21T01:21:11.302ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 201128907 } })
49462024-11-21T01:21:11.302ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 201148208 } })
49472024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
49482024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
49492024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49502024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49512024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
49522024-11-21T01:21:11.302ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49532024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
49542024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49552024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49562024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49572024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
49582024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49592024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49602024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49612024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49622024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49632024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49642024-11-21T01:21:11.302ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
49652024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.364089ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
49662024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
49672024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.43845ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
49682024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
49692024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49702024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
49712024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49722024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
49732024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49742024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
49752024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
49762024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49772024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49782024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
49792024-11-21T01:21:11.303ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49802024-11-21T01:21:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49812024-11-21T01:21:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49822024-11-21T01:21:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49832024-11-21T01:21:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49842024-11-21T01:21:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49852024-11-21T01:21:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49862024-11-21T01:21:11.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49872024-11-21T01:21:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49882024-11-21T01:21:11.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 203757024 } })
49892024-11-21T01:21:11.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49902024-11-21T01:21:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49912024-11-21T01:21:11.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
49922024-11-21T01:21:11.305ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:11:11.301590347 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49932024-11-21T01:21:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.29769ms iteration = 5 status = {"expiration":"2024-11-21T01:11:11.301590347Z","pruned":[]}
49942024-11-21T01:21:11.306ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.818047ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49952024-11-21T01:21:11.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49962024-11-21T01:21:11.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49972024-11-21T01:21:11.309ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49982024-11-21T01:21:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49992024-11-21T01:21:11.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50002024-11-21T01:21:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50012024-11-21T01:21:11.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50022024-11-21T01:21:11.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50032024-11-21T01:21:11.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50042024-11-21T01:21:11.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50052024-11-21T01:21:11.312ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50062024-11-21T01:21:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50072024-11-21T01:21:11.318ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.261991ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
50082024-11-21T01:21:11.360ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50092024-11-21T01:21:11.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50102024-11-21T01:21:11.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112024-11-21T01:21:11.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50122024-11-21T01:21:11.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50132024-11-21T01:21:11.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50142024-11-21T01:21:11.364ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50152024-11-21T01:21:11.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50162024-11-21T01:21:11.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50172024-11-21T01:21:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50182024-11-21T01:21:11.366ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50192024-11-21T01:21:11.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.471314ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
50202024-11-21T01:21:11.367ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50212024-11-21T01:21:11.368ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50222024-11-21T01:21:11.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50232024-11-21T01:21:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50242024-11-21T01:21:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50252024-11-21T01:21:11.369ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50262024-11-21T01:21:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50272024-11-21T01:21:11.370ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50282024-11-21T01:21:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50292024-11-21T01:21:11.370ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50302024-11-21T01:21:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50312024-11-21T01:21:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50322024-11-21T01:21:11.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50332024-11-21T01:21:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50342024-11-21T01:21:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50352024-11-21T01:21:11.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50362024-11-21T01:21:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50372024-11-21T01:21:11.372ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50382024-11-21T01:21:11.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.198214ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50392024-11-21T01:21:11.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50402024-11-21T01:21:11.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50412024-11-21T01:21:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50422024-11-21T01:21:11.374ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50432024-11-21T01:21:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50442024-11-21T01:21:11.375ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50452024-11-21T01:21:11.375ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50462024-11-21T01:21:11.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50472024-11-21T01:21:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50482024-11-21T01:21:11.376ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50492024-11-21T01:21:11.376ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50502024-11-21T01:21:11.376ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.116036ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50512024-11-21T01:21:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50522024-11-21T01:21:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50532024-11-21T01:21:11.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50542024-11-21T01:21:11.380ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50552024-11-21T01:21:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50562024-11-21T01:21:11.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.76315ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
50572024-11-21T01:21:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50582024-11-21T01:21:11.383ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50592024-11-21T01:21:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50602024-11-21T01:21:11.387ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50612024-11-21T01:21:11.387ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.712514ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50622024-11-21T01:21:11.388ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 287409743 } })
50632024-11-21T01:21:11.389ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
50642024-11-21T01:21:11.390ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50652024-11-21T01:21:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50662024-11-21T01:21:11.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50672024-11-21T01:21:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50682024-11-21T01:21:11.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50692024-11-21T01:21:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50702024-11-21T01:21:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.812848ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50712024-11-21T01:21:11.409ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1250, tv_nsec: 307808000 } })
50722024-11-21T01:21:11.409ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
50732024-11-21T01:21:11.420ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50742024-11-21T01:21:11.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50752024-11-21T01:21:11.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50762024-11-21T01:21:11.421ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 119.359872ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50772024-11-21T01:21:11.427ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50782024-11-21T01:21:11.427ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50792024-11-21T01:21:11.427ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50802024-11-21T01:21:11.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50812024-11-21T01:21:11.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50822024-11-21T01:21:11.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50832024-11-21T01:21:11.428ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50842024-11-21T01:21:11.428ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50852024-11-21T01:21:11.428ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50862024-11-21T01:21:11.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50872024-11-21T01:21:11.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50882024-11-21T01:21:11.429ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50892024-11-21T01:21:11.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50902024-11-21T01:21:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50912024-11-21T01:21:11.429ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50922024-11-21T01:21:11.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50932024-11-21T01:21:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50942024-11-21T01:21:11.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50952024-11-21T01:21:11.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50962024-11-21T01:21:11.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50972024-11-21T01:21:11.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50982024-11-21T01:21:11.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50992024-11-21T01:21:11.434ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51002024-11-21T01:21:11.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
51012024-11-21T01:21:11.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51022024-11-21T01:21:11.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51032024-11-21T01:21:11.434ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51042024-11-21T01:21:11.434ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51052024-11-21T01:21:11.434ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 132.999184ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51062024-11-21T01:21:11.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51072024-11-21T01:21:11.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51082024-11-21T01:21:11.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51092024-11-21T01:21:11.436ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51102024-11-21T01:21:11.436ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51112024-11-21T01:21:11.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51122024-11-21T01:21:11.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51132024-11-21T01:21:11.439ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51142024-11-21T01:21:11.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51152024-11-21T01:21:11.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51162024-11-21T01:21:11.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51172024-11-21T01:21:11.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51182024-11-21T01:21:11.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51192024-11-21T01:21:11.464ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
51202024-11-21T01:21:11.464ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51212024-11-21T01:21:11.465ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06e0d7fc-a3f9-4681-b820-5a9822d2b879", "content-length": "26", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
51222024-11-21T01:21:11.465ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51232024-11-21T01:21:11.467ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51242024-11-21T01:21:11.470ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51252024-11-21T01:21:11.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51262024-11-21T01:21:11.481ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51272024-11-21T01:21:11.481ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
51282024-11-21T01:21:11.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51292024-11-21T01:21:11.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51302024-11-21T01:21:11.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 179.940376ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51312024-11-21T01:21:11.486ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51322024-11-21T01:21:11.486ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51332024-11-21T01:21:11.486ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 183.902782ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51342024-11-21T01:21:11.487ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51352024-11-21T01:21:11.487ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51362024-11-21T01:21:11.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51372024-11-21T01:21:11.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51382024-11-21T01:21:11.491ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
51392024-11-21T01:21:11.491ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 189.955226ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51402024-11-21T01:21:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51412024-11-21T01:21:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51422024-11-21T01:21:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51432024-11-21T01:21:11.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51442024-11-21T01:21:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51452024-11-21T01:21:11.497ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
51462024-11-21T01:21:11.497ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 194.546611ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51472024-11-21T01:21:11.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51482024-11-21T01:21:11.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51492024-11-21T01:21:11.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51502024-11-21T01:21:11.499ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
51512024-11-21T01:21:11.499ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51522024-11-21T01:21:11.499ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
51532024-11-21T01:21:11.499ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 197.376401ms iteration = 5 status = {"generation":2}
51542024-11-21T01:21:11.500ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
51552024-11-21T01:21:11.500ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51562024-11-21T01:21:11.500ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
51572024-11-21T01:21:11.500ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 198.561318ms iteration = 5 status = {"generation":1}
51582024-11-21T01:21:11.512ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 210.270953ms iteration = 11 status = {"physical_disks_added":0}
51592024-11-21T01:21:11.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
51602024-11-21T01:21:11.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 252.880344ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
51612024-11-21T01:21:11.557ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
51622024-11-21T01:21:11.557ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51632024-11-21T01:21:11.557ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e914853a-ef46-445a-8183-f932818d4241", "content-length": "26", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
51642024-11-21T01:21:11.557ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51652024-11-21T01:21:11.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
51662024-11-21T01:21:11.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51672024-11-21T01:21:11.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51682024-11-21T01:21:11.577ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51692024-11-21T01:21:11.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 998e4f87-aaac-4279-b1fb-b7d8616e5141 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51702024-11-21T01:21:11.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 998e4f87-aaac-4279-b1fb-b7d8616e5141 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51712024-11-21T01:21:11.610ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
51722024-11-21T01:21:11.610ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d62e6f13-5744-478e-a3d1-2123403375e3", "date": "Thu, 21 Nov 2024 01:21:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51732024-11-21T01:21:11.610ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51742024-11-21T01:21:11.611ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "84f84e9d-4d96-433c-85d2-e3dfd84bd8c7", "date": "Thu, 21 Nov 2024 01:21:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51752024-11-21T01:21:11.611ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51762024-11-21T01:21:11.613ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
51772024-11-21T01:21:11.613ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 311.406108ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51782024-11-21T01:21:11.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
51792024-11-21T01:21:11.713ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51802024-11-21T01:21:11.713ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03e1145c-78c4-49e6-aa12-ac1b0cde01b5", "content-length": "26", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
51812024-11-21T01:21:11.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51822024-11-21T01:21:11.715ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51832024-11-21T01:21:11.718ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
51842024-11-21T01:21:11.719ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "45c4fd25-ca1a-41d6-bc4b-10be833998e3", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
51852024-11-21T01:21:11.719ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
51862024-11-21T01:21:11.720ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b793619f-4436-41ff-899d-a87358cf2305", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
51872024-11-21T01:21:11.720ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
51882024-11-21T01:21:11.722ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5d119191-d2e6-4e97-af18-6719ced88cd3", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
51892024-11-21T01:21:11.722ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
51902024-11-21T01:21:11.724ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
51912024-11-21T01:21:11.724ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 422.728057ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
51922024-11-21T01:21:11.791ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51932024-11-21T01:21:11.791ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c544821-a0cd-4a57-a33d-296292819035", "content-length": "1", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
51942024-11-21T01:21:11.794ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51952024-11-21T01:21:11.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51962024-11-21T01:21:11.800ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51972024-11-21T01:21:11.800ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51982024-11-21T01:21:11.800ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a168de6d-0094-491d-9bf2-d9a9c7703c33", "content-length": "372", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
51992024-11-21T01:21:11.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52002024-11-21T01:21:11.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52012024-11-21T01:21:11.803ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 501.643349ms iteration = 9 status = null
52022024-11-21T01:21:11.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 998e4f87-aaac-4279-b1fb-b7d8616e5141 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
52032024-11-21T01:21:11.818ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 517.017506ms iteration = 9 status = {}
52042024-11-21T01:21:11.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52052024-11-21T01:21:11.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52062024-11-21T01:21:11.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52072024-11-21T01:21:11.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52082024-11-21T01:21:11.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52092024-11-21T01:21:11.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52102024-11-21T01:21:11.834ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52112024-11-21T01:21:11.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52122024-11-21T01:21:11.843ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
52132024-11-21T01:21:11.843ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52142024-11-21T01:21:11.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b28190a7-b073-4582-8ea2-cdc9cd51a189", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
52152024-11-21T01:21:11.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52162024-11-21T01:21:11.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52172024-11-21T01:21:11.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52182024-11-21T01:21:11.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52192024-11-21T01:21:11.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52202024-11-21T01:21:11.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52212024-11-21T01:21:11.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52222024-11-21T01:21:11.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52232024-11-21T01:21:11.850ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
52242024-11-21T01:21:11.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52252024-11-21T01:21:11.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52262024-11-21T01:21:11.852ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52272024-11-21T01:21:11.852ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52282024-11-21T01:21:11.852ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1806cf58-638e-4ad8-95fb-f7ae3e759e5f", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
52292024-11-21T01:21:11.853ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 550.938834ms iteration = 9 status = {}
52302024-11-21T01:21:11.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52312024-11-21T01:21:11.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52322024-11-21T01:21:11.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52332024-11-21T01:21:11.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52342024-11-21T01:21:11.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52352024-11-21T01:21:11.862ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52362024-11-21T01:21:11.862ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ddd0c7d-180b-4e2d-91dc-fb4f30781254", "content-length": "134", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
52372024-11-21T01:21:11.862ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
52382024-11-21T01:21:11.862ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
52392024-11-21T01:21:11.862ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52402024-11-21T01:21:11.862ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52412024-11-21T01:21:11.862ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52422024-11-21T01:21:11.862ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52432024-11-21T01:21:11.862ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52442024-11-21T01:21:11.862ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52452024-11-21T01:21:11.863ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52462024-11-21T01:21:11.863ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52472024-11-21T01:21:11.863ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
52482024-11-21T01:21:11.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52492024-11-21T01:21:11.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
52502024-11-21T01:21:11.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52512024-11-21T01:21:11.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52522024-11-21T01:21:11.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52532024-11-21T01:21:11.865ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 563.688854ms iteration = 9 status = 0
52542024-11-21T01:21:11.865ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52552024-11-21T01:21:11.865ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1459a6b-157b-415d-aef8-6d727988e138", "content-length": "2", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
52562024-11-21T01:21:11.865ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52572024-11-21T01:21:11.865ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "63a0697b-4139-46cc-84f3-2b404e726d05", "content-length": "51", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
52582024-11-21T01:21:11.865ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
52592024-11-21T01:21:11.865ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52602024-11-21T01:21:11.924ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52612024-11-21T01:21:11.955ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "86177100-d452-426d-a8df-b24ab34a1b3b", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
52622024-11-21T01:21:11.955ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
52632024-11-21T01:21:11.955ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52642024-11-21T01:21:11.955ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c3d5c8b-4c12-444f-9d57-a8f63cf6ce96", "content-length": "691", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
52652024-11-21T01:21:11.955ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
52662024-11-21T01:21:11.955ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
52672024-11-21T01:21:11.955ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
52682024-11-21T01:21:11.955ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfaaa53a-9b21-47d5-ae3b-96aa229c82d1", "content-length": "682", "date": "Thu, 21 Nov 2024 01:21:11 GMT"} })
52692024-11-21T01:21:11.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52702024-11-21T01:21:11.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52712024-11-21T01:21:11.956ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 654.497263ms iteration = 9 status = {}
52722024-11-21T01:21:11.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52732024-11-21T01:21:11.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52742024-11-21T01:21:11.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52752024-11-21T01:21:11.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52762024-11-21T01:21:11.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52772024-11-21T01:21:11.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52782024-11-21T01:21:11.972ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 670.520039ms iteration = 9 status = {}
52792024-11-21T01:21:11.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 948fcadf-3589-497d-afbe-0aa283f86810 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52802024-11-21T01:21:11.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 948fcadf-3589-497d-afbe-0aa283f86810 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52812024-11-21T01:21:11.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 948fcadf-3589-497d-afbe-0aa283f86810 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52822024-11-21T01:21:13.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52582031-d6ae-44ae-ac57-717127f8bdfe roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52832024-11-21T01:21:13.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52582031-d6ae-44ae-ac57-717127f8bdfe resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52842024-11-21T01:21:13.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52582031-d6ae-44ae-ac57-717127f8bdfe response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52852024-11-21T01:21:14.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 74264578-d7fa-4956-8d89-33d2a8141f2f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52862024-11-21T01:21:14.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 74264578-d7fa-4956-8d89-33d2a8141f2f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52872024-11-21T01:21:14.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 74264578-d7fa-4956-8d89-33d2a8141f2f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52882024-11-21T01:21:15.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4419ed5d-c20a-4939-b685-c899c2950153 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52892024-11-21T01:21:15.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4419ed5d-c20a-4939-b685-c899c2950153 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52902024-11-21T01:21:15.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4419ed5d-c20a-4939-b685-c899c2950153 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52912024-11-21T01:21:16.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87c8685b-d29a-4d07-801a-d9454755fc21 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52922024-11-21T01:21:16.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87c8685b-d29a-4d07-801a-d9454755fc21 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52932024-11-21T01:21:16.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87c8685b-d29a-4d07-801a-d9454755fc21 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52942024-11-21T01:21:17.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7540e832-882f-4a77-a5d2-ff0f026a9ac0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52952024-11-21T01:21:17.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7540e832-882f-4a77-a5d2-ff0f026a9ac0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52962024-11-21T01:21:17.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7540e832-882f-4a77-a5d2-ff0f026a9ac0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52972024-11-21T01:21:18.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3eec04a9-bc21-41ce-8e2f-6d1dd1438e4a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52982024-11-21T01:21:18.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3eec04a9-bc21-41ce-8e2f-6d1dd1438e4a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
52992024-11-21T01:21:18.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3eec04a9-bc21-41ce-8e2f-6d1dd1438e4a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53002024-11-21T01:21:18.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 875 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 2f4d11e0-2b1b-431e-a528-68613cfa8484 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
53012024-11-21T01:21:19.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0494692b-0f3d-45cf-b05c-4ebbe288c83b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53022024-11-21T01:21:19.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0494692b-0f3d-45cf-b05c-4ebbe288c83b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53032024-11-21T01:21:19.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0494692b-0f3d-45cf-b05c-4ebbe288c83b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53042024-11-21T01:21:20.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8552741c-b8c8-4759-814f-1e5b51c4091f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53052024-11-21T01:21:20.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8552741c-b8c8-4759-814f-1e5b51c4091f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53062024-11-21T01:21:20.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8552741c-b8c8-4759-814f-1e5b51c4091f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53072024-11-21T01:21:21.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a1e5fafe-c46b-493e-86b6-b3a92c8557d0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53082024-11-21T01:21:21.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a1e5fafe-c46b-493e-86b6-b3a92c8557d0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53092024-11-21T01:21:21.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a1e5fafe-c46b-493e-86b6-b3a92c8557d0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53102024-11-21T01:21:21.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
53112024-11-21T01:21:21.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53122024-11-21T01:21:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53132024-11-21T01:21:21.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
53142024-11-21T01:21:21.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53152024-11-21T01:21:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53162024-11-21T01:21:21.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53172024-11-21T01:21:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53182024-11-21T01:21:21.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53192024-11-21T01:21:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53202024-11-21T01:21:21.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53212024-11-21T01:21:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53222024-11-21T01:21:21.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53232024-11-21T01:21:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
53242024-11-21T01:21:21.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53252024-11-21T01:21:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53262024-11-21T01:21:21.322ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
53272024-11-21T01:21:21.322ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.336667ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
53282024-11-21T01:21:21.331ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53292024-11-21T01:21:21.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53302024-11-21T01:21:21.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.917728ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53312024-11-21T01:21:22.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cca7cb9a-152e-462d-89ae-e439db49c90c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53322024-11-21T01:21:22.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cca7cb9a-152e-462d-89ae-e439db49c90c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53332024-11-21T01:21:22.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cca7cb9a-152e-462d-89ae-e439db49c90c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53342024-11-21T01:21:23.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e3bef069-f0f9-43d0-9d5d-519c3531edf1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53352024-11-21T01:21:23.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e3bef069-f0f9-43d0-9d5d-519c3531edf1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53362024-11-21T01:21:23.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e3bef069-f0f9-43d0-9d5d-519c3531edf1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53372024-11-21T01:21:24.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3cfb2af3-9aa6-4819-8e86-b2599da61648 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53382024-11-21T01:21:24.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3cfb2af3-9aa6-4819-8e86-b2599da61648 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53392024-11-21T01:21:24.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3cfb2af3-9aa6-4819-8e86-b2599da61648 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53402024-11-21T01:21:25.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c909bea4-4333-4bb1-8285-2ca518f33e5b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53412024-11-21T01:21:25.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c909bea4-4333-4bb1-8285-2ca518f33e5b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53422024-11-21T01:21:25.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c909bea4-4333-4bb1-8285-2ca518f33e5b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53432024-11-21T01:21:26.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7cbd31e-ac31-4096-b990-7bbf9cd8ce6b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53442024-11-21T01:21:26.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7cbd31e-ac31-4096-b990-7bbf9cd8ce6b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53452024-11-21T01:21:26.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7cbd31e-ac31-4096-b990-7bbf9cd8ce6b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53462024-11-21T01:21:27.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e17b8ba-05d4-40b0-8ceb-1f1e967e04d8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53472024-11-21T01:21:27.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e17b8ba-05d4-40b0-8ceb-1f1e967e04d8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53482024-11-21T01:21:27.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e17b8ba-05d4-40b0-8ceb-1f1e967e04d8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53492024-11-21T01:21:28.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9774b2ee-df60-4e9a-aee7-f825387af39c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53502024-11-21T01:21:28.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9774b2ee-df60-4e9a-aee7-f825387af39c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53512024-11-21T01:21:28.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9774b2ee-df60-4e9a-aee7-f825387af39c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53522024-11-21T01:21:29.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f18cb93-add3-4474-acea-229805ff9418 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53532024-11-21T01:21:29.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f18cb93-add3-4474-acea-229805ff9418 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53542024-11-21T01:21:29.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f18cb93-add3-4474-acea-229805ff9418 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53552024-11-21T01:21:30.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 75ffa473-622a-498a-bd0e-1347a1be858f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53562024-11-21T01:21:30.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 75ffa473-622a-498a-bd0e-1347a1be858f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53572024-11-21T01:21:30.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 75ffa473-622a-498a-bd0e-1347a1be858f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53582024-11-21T01:21:31.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
53592024-11-21T01:21:31.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53602024-11-21T01:21:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53612024-11-21T01:21:31.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
53622024-11-21T01:21:31.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53632024-11-21T01:21:31.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53642024-11-21T01:21:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53652024-11-21T01:21:31.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53662024-11-21T01:21:31.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53672024-11-21T01:21:31.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.072777ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53682024-11-21T01:21:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53692024-11-21T01:21:31.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53702024-11-21T01:21:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53712024-11-21T01:21:31.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53722024-11-21T01:21:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53732024-11-21T01:21:31.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53742024-11-21T01:21:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
53752024-11-21T01:21:31.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53762024-11-21T01:21:31.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53772024-11-21T01:21:31.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
53782024-11-21T01:21:31.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.480587ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
53792024-11-21T01:21:31.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3e588a25-10ef-4039-b468-39b4c050f4c8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53802024-11-21T01:21:31.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3e588a25-10ef-4039-b468-39b4c050f4c8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53812024-11-21T01:21:31.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3e588a25-10ef-4039-b468-39b4c050f4c8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53822024-11-21T01:21:32.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b123c8c8-f11b-4ccb-9cc9-dc200c4da23a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53832024-11-21T01:21:32.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b123c8c8-f11b-4ccb-9cc9-dc200c4da23a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53842024-11-21T01:21:32.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b123c8c8-f11b-4ccb-9cc9-dc200c4da23a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53852024-11-21T01:21:33.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e21042a-322f-4d8c-8121-434ddf8d6480 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53862024-11-21T01:21:33.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e21042a-322f-4d8c-8121-434ddf8d6480 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53872024-11-21T01:21:33.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9e21042a-322f-4d8c-8121-434ddf8d6480 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53882024-11-21T01:21:33.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 997828e8-6bc9-4f59-bf34-58cc6bf7b095 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
53892024-11-21T01:21:34.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ef246962-f660-4fd4-9ea1-17acd915d8d5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53902024-11-21T01:21:34.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ef246962-f660-4fd4-9ea1-17acd915d8d5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53912024-11-21T01:21:34.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ef246962-f660-4fd4-9ea1-17acd915d8d5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53922024-11-21T01:21:35.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 382a67a6-277c-4733-8ea9-0de36b268038 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53932024-11-21T01:21:35.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 382a67a6-277c-4733-8ea9-0de36b268038 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53942024-11-21T01:21:35.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 382a67a6-277c-4733-8ea9-0de36b268038 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53952024-11-21T01:21:36.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 68a086cc-1b06-4ad7-8688-29220e89e33f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53962024-11-21T01:21:36.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 68a086cc-1b06-4ad7-8688-29220e89e33f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53972024-11-21T01:21:36.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 68a086cc-1b06-4ad7-8688-29220e89e33f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53982024-11-21T01:21:37.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 078c7da4-bcce-4dad-b338-86979b3364f2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
53992024-11-21T01:21:37.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 078c7da4-bcce-4dad-b338-86979b3364f2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54002024-11-21T01:21:37.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 078c7da4-bcce-4dad-b338-86979b3364f2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54012024-11-21T01:21:38.480ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:49929
54022024-11-21T01:21:38.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49929 req_id = 19f78d3b-aea2-4fb7-a91e-6e09b9e17c69 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
54032024-11-21T01:21:38.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49929 req_id = 19f78d3b-aea2-4fb7-a91e-6e09b9e17c69 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
54042024-11-21T01:21:38.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49929 req_id = 19f78d3b-aea2-4fb7-a91e-6e09b9e17c69 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
54052024-11-21T01:21:38.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49929 req_id = 77858c8d-0e8e-44fc-9f93-17af9b7720bd roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
54062024-11-21T01:21:38.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49929 req_id = 77858c8d-0e8e-44fc-9f93-17af9b7720bd resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
54072024-11-21T01:21:38.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49929 req_id = 77858c8d-0e8e-44fc-9f93-17af9b7720bd response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
54082024-11-21T01:21:38.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1efbd8da-0ce3-4a24-b7f4-c6caeb85dab5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54092024-11-21T01:21:38.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1efbd8da-0ce3-4a24-b7f4-c6caeb85dab5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54102024-11-21T01:21:38.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1efbd8da-0ce3-4a24-b7f4-c6caeb85dab5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54112024-11-21T01:21:39.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9b985abe-5d64-4110-94f6-f159afaa69c0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54122024-11-21T01:21:39.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9b985abe-5d64-4110-94f6-f159afaa69c0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54132024-11-21T01:21:39.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9b985abe-5d64-4110-94f6-f159afaa69c0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54142024-11-21T01:21:40.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ab42909-7d9e-47da-aa3d-5cdd87cdc9b4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54152024-11-21T01:21:40.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ab42909-7d9e-47da-aa3d-5cdd87cdc9b4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54162024-11-21T01:21:40.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ab42909-7d9e-47da-aa3d-5cdd87cdc9b4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
54172024-11-21T01:21:40.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 90d903da-11be-4d08-98ef-368304d56498 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
54182024-11-21T01:21:40.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 90d903da-11be-4d08-98ef-368304d56498 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
54192024-11-21T01:21:40.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 90d903da-11be-4d08-98ef-368304d56498 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
54202024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
54212024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54222024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
54232024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54242024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
54252024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
54262024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54272024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54282024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
54292024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
54302024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54312024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
54322024-11-21T01:21:41.301ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54332024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54342024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
54352024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
54362024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54372024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54382024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54392024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54402024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54412024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54422024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54432024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54442024-11-21T01:21:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54452024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
54462024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54472024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54482024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
54492024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54502024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
54512024-11-21T01:21:41.303ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54522024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54532024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
54542024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54552024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54562024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54572024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54582024-11-21T01:21:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54592024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
54602024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54612024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
54622024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54632024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
54642024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
54652024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54662024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54672024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54682024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54692024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54702024-11-21T01:21:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54712024-11-21T01:21:41.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1280, tv_nsec: 203584602 } })
54722024-11-21T01:21:41.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54732024-11-21T01:21:41.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
54742024-11-21T01:21:41.305ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.744293ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54752024-11-21T01:21:41.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54762024-11-21T01:21:41.306ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1280, tv_nsec: 204992342 } })
54772024-11-21T01:21:41.306ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
54782024-11-21T01:21:41.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792024-11-21T01:21:41.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802024-11-21T01:21:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54812024-11-21T01:21:41.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54822024-11-21T01:21:41.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54832024-11-21T01:21:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54842024-11-21T01:21:41.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54852024-11-21T01:21:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54862024-11-21T01:21:41.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54872024-11-21T01:21:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54882024-11-21T01:21:41.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54892024-11-21T01:21:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54902024-11-21T01:21:41.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54912024-11-21T01:21:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54922024-11-21T01:21:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54932024-11-21T01:21:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54942024-11-21T01:21:41.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54952024-11-21T01:21:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54962024-11-21T01:21:41.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54972024-11-21T01:21:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54982024-11-21T01:21:41.315ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1280, tv_nsec: 214342613 } })
54992024-11-21T01:21:41.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55002024-11-21T01:21:41.316ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
55012024-11-21T01:21:41.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55022024-11-21T01:21:41.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55032024-11-21T01:21:41.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55042024-11-21T01:21:41.323ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55052024-11-21T01:21:41.323ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.333367ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55062024-11-21T01:21:41.345ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55072024-11-21T01:21:41.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55082024-11-21T01:21:41.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55092024-11-21T01:21:41.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55102024-11-21T01:21:41.351ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55112024-11-21T01:21:41.351ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55122024-11-21T01:21:41.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55132024-11-21T01:21:41.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55142024-11-21T01:21:41.353ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55152024-11-21T01:21:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55162024-11-21T01:21:41.353ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55172024-11-21T01:21:41.353ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55182024-11-21T01:21:41.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55192024-11-21T01:21:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55202024-11-21T01:21:41.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55212024-11-21T01:21:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55222024-11-21T01:21:41.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55232024-11-21T01:21:41.354ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55242024-11-21T01:21:41.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55252024-11-21T01:21:41.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55262024-11-21T01:21:41.356ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55272024-11-21T01:21:41.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55282024-11-21T01:21:41.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55292024-11-21T01:21:41.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55302024-11-21T01:21:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
55312024-11-21T01:21:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55322024-11-21T01:21:41.359ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55332024-11-21T01:21:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55342024-11-21T01:21:41.359ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55352024-11-21T01:21:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55362024-11-21T01:21:41.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.962455ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
55372024-11-21T01:21:41.364ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55382024-11-21T01:21:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55392024-11-21T01:21:41.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.448452ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
55402024-11-21T01:21:41.365ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.703758ms iteration = 10 status = 0
55412024-11-21T01:21:41.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.71615ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55422024-11-21T01:21:41.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55432024-11-21T01:21:41.367ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55442024-11-21T01:21:41.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55452024-11-21T01:21:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55462024-11-21T01:21:41.369ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55472024-11-21T01:21:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55482024-11-21T01:21:41.370ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55492024-11-21T01:21:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55502024-11-21T01:21:41.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55512024-11-21T01:21:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
55522024-11-21T01:21:41.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55532024-11-21T01:21:41.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55542024-11-21T01:21:41.385ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 81.439888ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55552024-11-21T01:21:41.385ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
55562024-11-21T01:21:41.385ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55572024-11-21T01:21:41.385ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c82fafb-b595-49ef-ba0b-d0e641c2f5a8", "content-length": "26", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
55582024-11-21T01:21:41.385ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55592024-11-21T01:21:41.386ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.343248ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55602024-11-21T01:21:41.388ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55612024-11-21T01:21:41.388ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
55622024-11-21T01:21:41.388ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55632024-11-21T01:21:41.388ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
55642024-11-21T01:21:41.388ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.036006ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
55652024-11-21T01:21:41.389ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d85633b2-3289-470f-a738-4344dab820e0", "content-length": "26", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
55662024-11-21T01:21:41.389ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55672024-11-21T01:21:41.391ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55682024-11-21T01:21:41.396ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.314335ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55692024-11-21T01:21:41.397ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55702024-11-21T01:21:41.397ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55712024-11-21T01:21:41.397ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.636113ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55722024-11-21T01:21:41.405ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 103.201554ms iteration = 12 status = {"physical_disks_added":0}
55732024-11-21T01:21:41.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
55742024-11-21T01:21:41.439ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55752024-11-21T01:21:41.440ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52e1fb10-7358-4aa4-a820-208d1a494e9f", "content-length": "26", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
55762024-11-21T01:21:41.440ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55772024-11-21T01:21:41.441ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
55782024-11-21T01:21:41.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55792024-11-21T01:21:41.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55802024-11-21T01:21:41.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55812024-11-21T01:21:41.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55822024-11-21T01:21:41.454ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55832024-11-21T01:21:41.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55842024-11-21T01:21:41.487ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 185.509795ms iteration = 10 status = {}
55852024-11-21T01:21:41.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55862024-11-21T01:21:41.491ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55872024-11-21T01:21:41.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55882024-11-21T01:21:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55892024-11-21T01:21:41.514ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55902024-11-21T01:21:41.515ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b449aca-990f-45ef-aaec-2681bd71a365", "content-length": "1", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
55912024-11-21T01:21:41.516ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55922024-11-21T01:21:41.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55932024-11-21T01:21:41.518ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 216.572752ms iteration = 10 status = null
55942024-11-21T01:21:41.529ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55952024-11-21T01:21:41.529ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55962024-11-21T01:21:41.529ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "99e9ddef-8b75-45cb-9f0e-c3ef137015db", "content-length": "372", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
55972024-11-21T01:21:41.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55982024-11-21T01:21:41.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55992024-11-21T01:21:41.544ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
56002024-11-21T01:21:41.544ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56012024-11-21T01:21:41.544ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0f77a0a6-d9a0-4c8c-b84d-f8240908347e", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
56022024-11-21T01:21:41.544ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56032024-11-21T01:21:41.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56042024-11-21T01:21:41.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56052024-11-21T01:21:41.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56062024-11-21T01:21:41.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56072024-11-21T01:21:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56082024-11-21T01:21:41.553ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56092024-11-21T01:21:41.553ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56102024-11-21T01:21:41.554ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3ab22861-a090-4e93-b420-6d7317e8183f", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
56112024-11-21T01:21:41.555ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 252.58309ms iteration = 10 status = {}
56122024-11-21T01:21:41.604ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56132024-11-21T01:21:41.605ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "47ac3ec8-b0a8-428d-b31d-67b29aad1790", "content-length": "691", "date": "Thu, 21 Nov 2024 01:21:41 GMT"} })
56142024-11-21T01:21:41.605ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
56152024-11-21T01:21:41.605ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56162024-11-21T01:21:41.605ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56172024-11-21T01:21:41.606ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 305.10782ms iteration = 10 status = {}
56182024-11-21T01:21:41.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56192024-11-21T01:21:41.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56202024-11-21T01:21:41.621ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
56212024-11-21T01:21:41.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56222024-11-21T01:21:41.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56232024-11-21T01:21:41.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f98a4273-0a05-4aeb-88b6-a5fd13c3d5a6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56242024-11-21T01:21:41.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f98a4273-0a05-4aeb-88b6-a5fd13c3d5a6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56252024-11-21T01:21:41.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f98a4273-0a05-4aeb-88b6-a5fd13c3d5a6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56262024-11-21T01:21:41.628ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56272024-11-21T01:21:41.628ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "af236578-c3da-4998-8121-205445461787", "content-length": "134", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
56282024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56292024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
56302024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56312024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56322024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56332024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56342024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56352024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56362024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56372024-11-21T01:21:41.628ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56382024-11-21T01:21:41.629ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
56392024-11-21T01:21:41.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56402024-11-21T01:21:41.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56412024-11-21T01:21:41.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56422024-11-21T01:21:41.631ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "39846e17-cae6-4862-a542-51607fdfafd1", "content-length": "2", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
56432024-11-21T01:21:41.631ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56442024-11-21T01:21:41.631ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "78af0896-b149-4763-83fe-d1cc50ce2f2c", "content-length": "51", "date": "Thu, 21 Nov 2024 01:21:40 GMT"} })
56452024-11-21T01:21:41.631ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
56462024-11-21T01:21:41.631ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56472024-11-21T01:21:41.726ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f1712b31-ad52-4abe-be4e-9fafc4f18ff5", "date": "Thu, 21 Nov 2024 01:21:41 GMT"} })
56482024-11-21T01:21:41.727ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
56492024-11-21T01:21:41.727ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56502024-11-21T01:21:41.727ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b45f9c51-a76b-42e3-ae51-0bbba74fb3be", "content-length": "682", "date": "Thu, 21 Nov 2024 01:21:41 GMT"} })
56512024-11-21T01:21:41.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56522024-11-21T01:21:41.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56532024-11-21T01:21:41.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56542024-11-21T01:21:41.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56552024-11-21T01:21:41.832ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56562024-11-21T01:21:41.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56572024-11-21T01:21:41.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56582024-11-21T01:21:41.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56592024-11-21T01:21:41.840ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 538.674531ms iteration = 10 status = {}
56602024-11-21T01:21:42.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c08bee0f-0f6e-4c8b-b05d-73b94b56de12 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56612024-11-21T01:21:42.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c08bee0f-0f6e-4c8b-b05d-73b94b56de12 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56622024-11-21T01:21:42.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c08bee0f-0f6e-4c8b-b05d-73b94b56de12 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56632024-11-21T01:21:43.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f8fddf8-1a02-4d6b-a33b-2618f5a90909 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56642024-11-21T01:21:43.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f8fddf8-1a02-4d6b-a33b-2618f5a90909 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56652024-11-21T01:21:43.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f8fddf8-1a02-4d6b-a33b-2618f5a90909 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56662024-11-21T01:21:44.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ae1de792-3a50-41e2-b2f3-24778f8ea351 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56672024-11-21T01:21:44.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ae1de792-3a50-41e2-b2f3-24778f8ea351 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56682024-11-21T01:21:44.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ae1de792-3a50-41e2-b2f3-24778f8ea351 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56692024-11-21T01:21:45.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 797b7646-4c25-4752-8694-269c466b0a0c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56702024-11-21T01:21:45.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 797b7646-4c25-4752-8694-269c466b0a0c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56712024-11-21T01:21:45.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 797b7646-4c25-4752-8694-269c466b0a0c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56722024-11-21T01:21:46.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0e3862eb-a594-4689-a1df-5e22490aa4d2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56732024-11-21T01:21:46.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0e3862eb-a594-4689-a1df-5e22490aa4d2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56742024-11-21T01:21:46.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0e3862eb-a594-4689-a1df-5e22490aa4d2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56752024-11-21T01:21:47.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8de0acb5-2a69-492e-a64b-64c65e0e09d6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56762024-11-21T01:21:47.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8de0acb5-2a69-492e-a64b-64c65e0e09d6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56772024-11-21T01:21:47.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8de0acb5-2a69-492e-a64b-64c65e0e09d6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56782024-11-21T01:21:48.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 607 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 70c3eba8-73d9-47c9-bd58-6d2ea65c9851 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
56792024-11-21T01:21:48.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 915b527a-9ca4-4326-83b1-41053952aa0b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56802024-11-21T01:21:48.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 915b527a-9ca4-4326-83b1-41053952aa0b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56812024-11-21T01:21:48.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 915b527a-9ca4-4326-83b1-41053952aa0b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56822024-11-21T01:21:49.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6c2102dd-ebba-4627-9d85-1c66cad13af4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56832024-11-21T01:21:49.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6c2102dd-ebba-4627-9d85-1c66cad13af4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56842024-11-21T01:21:49.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6c2102dd-ebba-4627-9d85-1c66cad13af4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56852024-11-21T01:21:50.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2259a985-0b53-4899-8fe4-0c9843ad7799 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56862024-11-21T01:21:50.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2259a985-0b53-4899-8fe4-0c9843ad7799 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56872024-11-21T01:21:50.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2259a985-0b53-4899-8fe4-0c9843ad7799 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
56882024-11-21T01:21:51.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
56892024-11-21T01:21:51.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56902024-11-21T01:21:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56912024-11-21T01:21:51.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
56922024-11-21T01:21:51.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56932024-11-21T01:21:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56942024-11-21T01:21:51.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56952024-11-21T01:21:51.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56962024-11-21T01:21:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56972024-11-21T01:21:51.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.165529ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56982024-11-21T01:21:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56992024-11-21T01:21:51.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57002024-11-21T01:21:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57012024-11-21T01:21:51.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57022024-11-21T01:21:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57032024-11-21T01:21:51.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57042024-11-21T01:21:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
57052024-11-21T01:21:51.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57062024-11-21T01:21:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57072024-11-21T01:21:51.326ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
57082024-11-21T01:21:51.326ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.12593ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
57092024-11-21T01:21:51.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 49beb428-fda1-426d-a739-9624b9cac0b1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57102024-11-21T01:21:51.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 49beb428-fda1-426d-a739-9624b9cac0b1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57112024-11-21T01:21:51.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 49beb428-fda1-426d-a739-9624b9cac0b1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57122024-11-21T01:21:52.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c02899ec-aad4-451a-aa2a-6139e9e29859 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57132024-11-21T01:21:52.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c02899ec-aad4-451a-aa2a-6139e9e29859 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57142024-11-21T01:21:52.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c02899ec-aad4-451a-aa2a-6139e9e29859 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57152024-11-21T01:21:53.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8ee8f619-8946-4d36-b049-b624d01bdf33 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57162024-11-21T01:21:53.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8ee8f619-8946-4d36-b049-b624d01bdf33 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57172024-11-21T01:21:53.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8ee8f619-8946-4d36-b049-b624d01bdf33 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57182024-11-21T01:21:54.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 447447f7-0bcc-409e-acea-5c72c9993972 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57192024-11-21T01:21:54.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 447447f7-0bcc-409e-acea-5c72c9993972 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57202024-11-21T01:21:54.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 447447f7-0bcc-409e-acea-5c72c9993972 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57212024-11-21T01:21:56.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 221331ae-8e2a-4dc0-817f-9a01a8d7128f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57222024-11-21T01:21:56.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 221331ae-8e2a-4dc0-817f-9a01a8d7128f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57232024-11-21T01:21:56.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 221331ae-8e2a-4dc0-817f-9a01a8d7128f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57242024-11-21T01:21:57.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9aae274c-bb0f-4f3b-ae59-df197b0ffa82 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57252024-11-21T01:21:57.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9aae274c-bb0f-4f3b-ae59-df197b0ffa82 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57262024-11-21T01:21:57.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9aae274c-bb0f-4f3b-ae59-df197b0ffa82 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57272024-11-21T01:21:58.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e6b0dbf-ce1d-4041-a971-f7d1d4a44ed2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57282024-11-21T01:21:58.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e6b0dbf-ce1d-4041-a971-f7d1d4a44ed2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57292024-11-21T01:21:58.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e6b0dbf-ce1d-4041-a971-f7d1d4a44ed2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57302024-11-21T01:21:59.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5b60c73a-53a2-48e8-8f80-a03d899cf9d1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57312024-11-21T01:21:59.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5b60c73a-53a2-48e8-8f80-a03d899cf9d1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57322024-11-21T01:21:59.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5b60c73a-53a2-48e8-8f80-a03d899cf9d1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57332024-11-21T01:22:00.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1b8dac51-1b3d-42e4-8d25-5eaa1372e8e2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57342024-11-21T01:22:00.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1b8dac51-1b3d-42e4-8d25-5eaa1372e8e2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57352024-11-21T01:22:00.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1b8dac51-1b3d-42e4-8d25-5eaa1372e8e2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57362024-11-21T01:22:01.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7573b0be-1ceb-4b13-a43a-1fe54ad244b5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57372024-11-21T01:22:01.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7573b0be-1ceb-4b13-a43a-1fe54ad244b5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57382024-11-21T01:22:01.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7573b0be-1ceb-4b13-a43a-1fe54ad244b5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57392024-11-21T01:22:01.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
57402024-11-21T01:22:01.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57412024-11-21T01:22:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57422024-11-21T01:22:01.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
57432024-11-21T01:22:01.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57442024-11-21T01:22:01.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57452024-11-21T01:22:01.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57462024-11-21T01:22:01.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57472024-11-21T01:22:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57482024-11-21T01:22:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57492024-11-21T01:22:01.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57502024-11-21T01:22:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57512024-11-21T01:22:01.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.857114ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57522024-11-21T01:22:01.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57532024-11-21T01:22:01.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57542024-11-21T01:22:01.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57552024-11-21T01:22:01.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
57562024-11-21T01:22:01.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57572024-11-21T01:22:01.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57582024-11-21T01:22:01.319ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
57592024-11-21T01:22:01.319ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.767151ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
57602024-11-21T01:22:02.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e159f9a-84ff-47d6-bb22-bdd4184c9e0b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57612024-11-21T01:22:02.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e159f9a-84ff-47d6-bb22-bdd4184c9e0b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57622024-11-21T01:22:02.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e159f9a-84ff-47d6-bb22-bdd4184c9e0b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57632024-11-21T01:22:03.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc755274-4fe3-410e-855a-8da8f3b8348f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57642024-11-21T01:22:03.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc755274-4fe3-410e-855a-8da8f3b8348f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57652024-11-21T01:22:03.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc755274-4fe3-410e-855a-8da8f3b8348f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57662024-11-21T01:22:03.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = fe93a189-8c41-4958-be20-74193a95c8a3 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
57672024-11-21T01:22:04.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d70a155-1458-4aa3-8561-39ddccd68a06 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57682024-11-21T01:22:04.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d70a155-1458-4aa3-8561-39ddccd68a06 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57692024-11-21T01:22:04.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d70a155-1458-4aa3-8561-39ddccd68a06 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57702024-11-21T01:22:05.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = de1821d5-1cc5-4586-8f79-6a3971e1c75e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57712024-11-21T01:22:05.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = de1821d5-1cc5-4586-8f79-6a3971e1c75e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57722024-11-21T01:22:05.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = de1821d5-1cc5-4586-8f79-6a3971e1c75e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57732024-11-21T01:22:06.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dcc8ab49-53f5-4695-9f20-d86984027a6b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57742024-11-21T01:22:06.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dcc8ab49-53f5-4695-9f20-d86984027a6b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57752024-11-21T01:22:06.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dcc8ab49-53f5-4695-9f20-d86984027a6b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57762024-11-21T01:22:07.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2b913295-c32b-40a6-aecb-9976af8f89ce roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57772024-11-21T01:22:07.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2b913295-c32b-40a6-aecb-9976af8f89ce resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57782024-11-21T01:22:07.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2b913295-c32b-40a6-aecb-9976af8f89ce response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57792024-11-21T01:22:08.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2961e616-fb9c-4077-957e-63e6ced16772 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57802024-11-21T01:22:08.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2961e616-fb9c-4077-957e-63e6ced16772 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57812024-11-21T01:22:08.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2961e616-fb9c-4077-957e-63e6ced16772 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57822024-11-21T01:22:09.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a815fffe-2305-421d-801b-fe3db7d3ea1c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57832024-11-21T01:22:09.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a815fffe-2305-421d-801b-fe3db7d3ea1c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57842024-11-21T01:22:09.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a815fffe-2305-421d-801b-fe3db7d3ea1c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57852024-11-21T01:22:10.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed9d07c4-d0d3-4b10-bac7-1663dfecbc44 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57862024-11-21T01:22:10.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed9d07c4-d0d3-4b10-bac7-1663dfecbc44 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57872024-11-21T01:22:10.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ed9d07c4-d0d3-4b10-bac7-1663dfecbc44 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
57882024-11-21T01:22:10.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 6a91df72-3bfd-40c8-bc30-4992b9c0bcd8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
57892024-11-21T01:22:10.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 6a91df72-3bfd-40c8-bc30-4992b9c0bcd8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
57902024-11-21T01:22:10.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 6a91df72-3bfd-40c8-bc30-4992b9c0bcd8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
57912024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
57922024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57932024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57942024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
57952024-11-21T01:22:11.302ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57962024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57972024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
57982024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
57992024-11-21T01:22:11.302ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
58002024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
58012024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.78\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
58022024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
58032024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58042024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
58052024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
58062024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58072024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
58082024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58092024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
58102024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
58112024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58122024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58132024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
58142024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58152024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
58162024-11-21T01:22:11.302ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:12:11.302740638 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
58172024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
58182024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
58192024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
58202024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
58212024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
58222024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58232024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
58242024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
58252024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58262024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58272024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
58282024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58292024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
58302024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58312024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
58322024-11-21T01:22:11.302ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58332024-11-21T01:22:11.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58342024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
58352024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
58362024-11-21T01:22:11.303ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
58372024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58382024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58392024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58402024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
58412024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58422024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
58432024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58442024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58452024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58462024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58472024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58482024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58492024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58502024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58512024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58522024-11-21T01:22:11.303ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 201768674 } })
58532024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58542024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
58552024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58562024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58572024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58582024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58592024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58602024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58612024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58622024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58632024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58642024-11-21T01:22:11.303ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 201956707 } })
58652024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
58662024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
58672024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58682024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58692024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
58702024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58712024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
58722024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58732024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
58742024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58752024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
58762024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58772024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
58782024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.247068ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
58792024-11-21T01:22:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58802024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58812024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58822024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58832024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58842024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58852024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
58862024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.369589ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
58872024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58882024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58892024-11-21T01:22:11.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58902024-11-21T01:22:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58912024-11-21T01:22:11.305ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58922024-11-21T01:22:11.306ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.673141ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58932024-11-21T01:22:11.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 206220857 } })
58942024-11-21T01:22:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58952024-11-21T01:22:11.307ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58962024-11-21T01:22:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58972024-11-21T01:22:11.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
58982024-11-21T01:22:11.310ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58992024-11-21T01:22:11.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59002024-11-21T01:22:11.311ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:12:11.302740638 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59012024-11-21T01:22:11.311ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.790424ms iteration = 6 status = {"expiration":"2024-11-21T01:12:11.302740638Z","pruned":[]}
59022024-11-21T01:22:11.311ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 210161163 } })
59032024-11-21T01:22:11.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042024-11-21T01:22:11.311ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
59052024-11-21T01:22:11.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59062024-11-21T01:22:11.312ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59072024-11-21T01:22:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59082024-11-21T01:22:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59092024-11-21T01:22:11.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59102024-11-21T01:22:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59112024-11-21T01:22:11.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59122024-11-21T01:22:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59132024-11-21T01:22:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59142024-11-21T01:22:11.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59152024-11-21T01:22:11.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59162024-11-21T01:22:11.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59172024-11-21T01:22:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59182024-11-21T01:22:11.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59192024-11-21T01:22:11.316ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59202024-11-21T01:22:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59212024-11-21T01:22:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59222024-11-21T01:22:11.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59232024-11-21T01:22:11.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59242024-11-21T01:22:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59252024-11-21T01:22:11.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59262024-11-21T01:22:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59272024-11-21T01:22:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59282024-11-21T01:22:11.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59292024-11-21T01:22:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59302024-11-21T01:22:11.320ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59312024-11-21T01:22:11.322ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.538242ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
59322024-11-21T01:22:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59332024-11-21T01:22:11.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59342024-11-21T01:22:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59352024-11-21T01:22:11.324ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59362024-11-21T01:22:11.324ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59372024-11-21T01:22:11.324ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.893545ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59382024-11-21T01:22:11.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59392024-11-21T01:22:11.327ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59402024-11-21T01:22:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59412024-11-21T01:22:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59422024-11-21T01:22:11.331ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59432024-11-21T01:22:11.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59442024-11-21T01:22:11.332ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59452024-11-21T01:22:11.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59462024-11-21T01:22:11.336ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1310, tv_nsec: 234659378 } })
59472024-11-21T01:22:11.336ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
59482024-11-21T01:22:11.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59492024-11-21T01:22:11.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59502024-11-21T01:22:11.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42919df3-0863-4441-8302-5b3c115537ca roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
59512024-11-21T01:22:11.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59522024-11-21T01:22:11.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42919df3-0863-4441-8302-5b3c115537ca resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
59532024-11-21T01:22:11.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59542024-11-21T01:22:11.342ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59552024-11-21T01:22:11.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59562024-11-21T01:22:11.345ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59572024-11-21T01:22:11.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59582024-11-21T01:22:11.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59592024-11-21T01:22:11.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
59602024-11-21T01:22:11.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59612024-11-21T01:22:11.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59622024-11-21T01:22:11.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59632024-11-21T01:22:11.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42919df3-0863-4441-8302-5b3c115537ca response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
59642024-11-21T01:22:11.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59652024-11-21T01:22:11.356ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59662024-11-21T01:22:11.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59672024-11-21T01:22:11.360ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59682024-11-21T01:22:11.360ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59692024-11-21T01:22:11.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59702024-11-21T01:22:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59712024-11-21T01:22:11.361ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 58.737197ms iteration = 13 status = {"physical_disks_added":0}
59722024-11-21T01:22:11.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59732024-11-21T01:22:11.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59742024-11-21T01:22:11.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.261454ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59752024-11-21T01:22:11.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59762024-11-21T01:22:11.366ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59772024-11-21T01:22:11.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59782024-11-21T01:22:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59792024-11-21T01:22:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59802024-11-21T01:22:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59812024-11-21T01:22:11.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59822024-11-21T01:22:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59832024-11-21T01:22:11.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59842024-11-21T01:22:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59852024-11-21T01:22:11.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59862024-11-21T01:22:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
59872024-11-21T01:22:11.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59882024-11-21T01:22:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59892024-11-21T01:22:11.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59902024-11-21T01:22:11.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.636466ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
59912024-11-21T01:22:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59922024-11-21T01:22:11.381ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59932024-11-21T01:22:11.381ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59942024-11-21T01:22:11.381ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59952024-11-21T01:22:11.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59962024-11-21T01:22:11.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59972024-11-21T01:22:11.383ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.013888ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
59982024-11-21T01:22:11.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59992024-11-21T01:22:11.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60002024-11-21T01:22:11.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60012024-11-21T01:22:11.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60022024-11-21T01:22:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
60032024-11-21T01:22:11.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60042024-11-21T01:22:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60052024-11-21T01:22:11.388ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
60062024-11-21T01:22:11.388ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.609237ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
60072024-11-21T01:22:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60082024-11-21T01:22:11.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60092024-11-21T01:22:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60102024-11-21T01:22:11.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60112024-11-21T01:22:11.390ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.652825ms iteration = 11 status = 0
60122024-11-21T01:22:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60132024-11-21T01:22:11.391ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
60142024-11-21T01:22:11.391ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
60152024-11-21T01:22:11.391ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.517378ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
60162024-11-21T01:22:11.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60172024-11-21T01:22:11.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60182024-11-21T01:22:11.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60192024-11-21T01:22:11.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60202024-11-21T01:22:11.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60212024-11-21T01:22:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60222024-11-21T01:22:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
60232024-11-21T01:22:11.397ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60242024-11-21T01:22:11.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60252024-11-21T01:22:11.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
60262024-11-21T01:22:11.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60272024-11-21T01:22:11.398ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60282024-11-21T01:22:11.398ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.719249ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60292024-11-21T01:22:11.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60302024-11-21T01:22:11.399ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.877565ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60312024-11-21T01:22:11.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60322024-11-21T01:22:11.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60332024-11-21T01:22:11.405ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60342024-11-21T01:22:11.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60352024-11-21T01:22:11.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60362024-11-21T01:22:11.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60372024-11-21T01:22:11.408ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60382024-11-21T01:22:11.408ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60392024-11-21T01:22:11.408ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60402024-11-21T01:22:11.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60412024-11-21T01:22:11.413ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60422024-11-21T01:22:11.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60432024-11-21T01:22:11.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60442024-11-21T01:22:11.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60452024-11-21T01:22:11.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.14893ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60462024-11-21T01:22:11.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60472024-11-21T01:22:11.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60482024-11-21T01:22:11.426ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
60492024-11-21T01:22:11.426ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
60502024-11-21T01:22:11.426ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
60512024-11-21T01:22:11.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60522024-11-21T01:22:11.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60532024-11-21T01:22:11.432ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
60542024-11-21T01:22:11.432ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
60552024-11-21T01:22:11.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60562024-11-21T01:22:11.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60572024-11-21T01:22:11.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60582024-11-21T01:22:11.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60592024-11-21T01:22:11.458ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60602024-11-21T01:22:11.478ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60612024-11-21T01:22:11.499ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
60622024-11-21T01:22:11.499ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60632024-11-21T01:22:11.499ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f345bf1b-d0d1-4159-b625-7399778afca5", "content-length": "26", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
60642024-11-21T01:22:11.500ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60652024-11-21T01:22:11.502ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
60662024-11-21T01:22:11.556ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60672024-11-21T01:22:11.556ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60682024-11-21T01:22:11.558ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60692024-11-21T01:22:11.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60702024-11-21T01:22:11.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60712024-11-21T01:22:11.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60722024-11-21T01:22:11.561ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60732024-11-21T01:22:11.561ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60742024-11-21T01:22:11.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60752024-11-21T01:22:11.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60762024-11-21T01:22:11.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60772024-11-21T01:22:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60782024-11-21T01:22:11.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60792024-11-21T01:22:11.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60802024-11-21T01:22:11.564ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60812024-11-21T01:22:11.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60822024-11-21T01:22:11.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60832024-11-21T01:22:11.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60842024-11-21T01:22:11.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60852024-11-21T01:22:11.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60862024-11-21T01:22:11.567ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60872024-11-21T01:22:11.568ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
60882024-11-21T01:22:11.568ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
60892024-11-21T01:22:11.568ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
60902024-11-21T01:22:11.568ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 266.243042ms iteration = 6 status = {"generation":1}
60912024-11-21T01:22:11.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
60922024-11-21T01:22:11.571ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60932024-11-21T01:22:11.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60942024-11-21T01:22:11.571ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
60952024-11-21T01:22:11.571ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 269.105222ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60962024-11-21T01:22:11.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60972024-11-21T01:22:11.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60982024-11-21T01:22:11.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60992024-11-21T01:22:11.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61002024-11-21T01:22:11.578ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61012024-11-21T01:22:11.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61022024-11-21T01:22:11.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61032024-11-21T01:22:11.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61042024-11-21T01:22:11.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61052024-11-21T01:22:11.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61062024-11-21T01:22:11.583ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
61072024-11-21T01:22:11.583ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61082024-11-21T01:22:11.584ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0e5e348-0595-4df5-8608-e5a2b338c851", "content-length": "26", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
61092024-11-21T01:22:11.584ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61102024-11-21T01:22:11.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61112024-11-21T01:22:11.585ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61122024-11-21T01:22:11.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61132024-11-21T01:22:11.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61142024-11-21T01:22:11.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 286.246054ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
61152024-11-21T01:22:11.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
61162024-11-21T01:22:11.591ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61172024-11-21T01:22:11.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61182024-11-21T01:22:11.594ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61192024-11-21T01:22:11.594ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61202024-11-21T01:22:11.594ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 291.167043ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61212024-11-21T01:22:11.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61222024-11-21T01:22:11.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61232024-11-21T01:22:11.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61242024-11-21T01:22:11.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61252024-11-21T01:22:11.602ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
61262024-11-21T01:22:11.602ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
61272024-11-21T01:22:11.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61282024-11-21T01:22:11.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61292024-11-21T01:22:11.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61302024-11-21T01:22:11.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61312024-11-21T01:22:11.608ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
61322024-11-21T01:22:11.608ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61332024-11-21T01:22:11.609ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "01de1784-a461-40e9-8967-8be952c24d00", "content-length": "26", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
61342024-11-21T01:22:11.609ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61352024-11-21T01:22:11.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61362024-11-21T01:22:11.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61372024-11-21T01:22:11.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61382024-11-21T01:22:11.610ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61392024-11-21T01:22:11.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
61402024-11-21T01:22:11.610ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61412024-11-21T01:22:11.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61422024-11-21T01:22:11.612ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
61432024-11-21T01:22:11.612ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
61442024-11-21T01:22:11.612ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
61452024-11-21T01:22:11.612ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 309.851396ms iteration = 6 status = {"generation":2}
61462024-11-21T01:22:11.617ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61472024-11-21T01:22:11.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61482024-11-21T01:22:11.619ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61492024-11-21T01:22:11.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61502024-11-21T01:22:11.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61512024-11-21T01:22:11.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61522024-11-21T01:22:11.624ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61532024-11-21T01:22:11.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61542024-11-21T01:22:11.626ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
61552024-11-21T01:22:11.626ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 323.359107ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61562024-11-21T01:22:11.627ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61572024-11-21T01:22:11.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61582024-11-21T01:22:11.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61592024-11-21T01:22:11.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61602024-11-21T01:22:11.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61612024-11-21T01:22:11.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61622024-11-21T01:22:11.631ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61632024-11-21T01:22:11.631ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d391e69b-dc01-4922-a88c-e0cce8f1950e", "date": "Thu, 21 Nov 2024 01:22:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61642024-11-21T01:22:11.631ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61652024-11-21T01:22:11.632ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61662024-11-21T01:22:11.633ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "62415169-61c9-42a3-9002-35d2a5c5f1ae", "date": "Thu, 21 Nov 2024 01:22:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61672024-11-21T01:22:11.633ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61682024-11-21T01:22:11.635ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61692024-11-21T01:22:11.635ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 332.322353ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
61702024-11-21T01:22:11.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
61712024-11-21T01:22:11.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61722024-11-21T01:22:11.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61732024-11-21T01:22:11.637ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61742024-11-21T01:22:11.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61752024-11-21T01:22:11.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61762024-11-21T01:22:11.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61772024-11-21T01:22:11.640ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61782024-11-21T01:22:11.643ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "13f486e0-c63e-4eba-9283-248886a10128", "content-length": "372", "date": "Thu, 21 Nov 2024 01:22:10 GMT"} })
61792024-11-21T01:22:11.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61802024-11-21T01:22:11.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
61812024-11-21T01:22:11.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61822024-11-21T01:22:11.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61832024-11-21T01:22:11.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61842024-11-21T01:22:11.645ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
61852024-11-21T01:22:11.652ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 63031233-d4cf-486c-a883-b94591ef6215, kind: Service { id: bbffc4db-58c5-4210-973d-49d52a55513e }, name: Name("nexus-bbffc4db-58c5-4210-973d-49d52a55513e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6eb7eb-9f19-4410-8b07-657b90ce790a, kind: Service { id: 5382fba6-edea-49d2-8ecc-9b1edfc688be }, name: Name("nexus-5382fba6-edea-49d2-8ecc-9b1edfc688be"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 138])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e349c246-31d7-4a6d-8e38-cf8679bf8d63, kind: Service { id: 3285ddd9-4901-4d45-8459-dd50ba0635ef }, name: Name("nexus-3285ddd9-4901-4d45-8459-dd50ba0635ef"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 4d6538e9-2779-4ffe-b732-b8ef5b68fff3, kind: Service { id: 50ef7a5a-8210-43f1-a548-846251e25074 }, name: Name("external-dns-50ef7a5a-8210-43f1-a548-846251e25074"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 90d25e95-e0a0-4767-914f-6a42c8b1e264, kind: Service { id: 403cce04-ffba-4276-94a6-76cab9338e71 }, name: Name("external-dns-403cce04-ffba-4276-94a6-76cab9338e71"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
61862024-11-21T01:22:11.652ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61872024-11-21T01:22:11.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61882024-11-21T01:22:11.654ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61892024-11-21T01:22:11.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
61902024-11-21T01:22:11.656ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61912024-11-21T01:22:11.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61922024-11-21T01:22:11.658ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
61932024-11-21T01:22:11.658ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4d6538e9-2779-4ffe-b732-b8ef5b68fff3, kind: Service { id: 50ef7a5a-8210-43f1-a548-846251e25074 }, name: Name("external-dns-50ef7a5a-8210-43f1-a548-846251e25074"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 90d25e95-e0a0-4767-914f-6a42c8b1e264, kind: Service { id: 403cce04-ffba-4276-94a6-76cab9338e71 }, name: Name("external-dns-403cce04-ffba-4276-94a6-76cab9338e71"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 63031233-d4cf-486c-a883-b94591ef6215, kind: Service { id: bbffc4db-58c5-4210-973d-49d52a55513e }, name: Name("nexus-bbffc4db-58c5-4210-973d-49d52a55513e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6eb7eb-9f19-4410-8b07-657b90ce790a, kind: Service { id: 5382fba6-edea-49d2-8ecc-9b1edfc688be }, name: Name("nexus-5382fba6-edea-49d2-8ecc-9b1edfc688be"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 138])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e349c246-31d7-4a6d-8e38-cf8679bf8d63, kind: Service { id: 3285ddd9-4901-4d45-8459-dd50ba0635ef }, name: Name("nexus-3285ddd9-4901-4d45-8459-dd50ba0635ef"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
61942024-11-21T01:22:11.658ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
61952024-11-21T01:22:11.658ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
61962024-11-21T01:22:11.658ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61972024-11-21T01:22:11.659ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e2e64d23-fbb0-48d3-ac31-3174a3159f3f", "date": "Thu, 21 Nov 2024 01:22:10 GMT"} })
61982024-11-21T01:22:11.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61992024-11-21T01:22:11.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62002024-11-21T01:22:11.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62012024-11-21T01:22:11.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62022024-11-21T01:22:11.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62032024-11-21T01:22:11.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62042024-11-21T01:22:11.666ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62052024-11-21T01:22:11.666ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62062024-11-21T01:22:11.667ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8148fa99-f1b6-4801-b19d-0a955de42250", "date": "Thu, 21 Nov 2024 01:22:10 GMT"} })
62072024-11-21T01:22:11.668ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 366.093619ms iteration = 11 status = {}
62082024-11-21T01:22:11.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62092024-11-21T01:22:11.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62102024-11-21T01:22:11.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62112024-11-21T01:22:11.676ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62122024-11-21T01:22:11.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62132024-11-21T01:22:11.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62142024-11-21T01:22:11.678ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62152024-11-21T01:22:11.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62162024-11-21T01:22:11.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62172024-11-21T01:22:11.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62182024-11-21T01:22:11.759ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62192024-11-21T01:22:11.760ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da34aa6f-7445-47a2-82a6-158efddbc705", "content-length": "1", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
62202024-11-21T01:22:11.761ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62212024-11-21T01:22:11.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62222024-11-21T01:22:11.764ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 461.581745ms iteration = 11 status = null
62232024-11-21T01:22:11.777ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62242024-11-21T01:22:11.777ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "22f26417-a619-4b77-8008-59cf641dedeb", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62252024-11-21T01:22:11.777ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62262024-11-21T01:22:11.779ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "121c2c5f-3a9f-47ae-9a04-735e02d474a2", "date": "Thu, 21 Nov 2024 01:22:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62272024-11-21T01:22:11.779ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62282024-11-21T01:22:11.780ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b90c2c24-24a1-49d8-a3e3-bece312067c9", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62292024-11-21T01:22:11.780ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62302024-11-21T01:22:11.782ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, time_created: 2024-11-21T01:17:13.128462Z, time_modified: 2024-11-21T01:17:13.128462Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
62312024-11-21T01:22:11.782ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
62322024-11-21T01:22:11.782ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62332024-11-21T01:22:11.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62342024-11-21T01:22:11.782ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62352024-11-21T01:22:11.782ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 480.103226ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62362024-11-21T01:22:11.784ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62372024-11-21T01:22:11.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62382024-11-21T01:22:11.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62392024-11-21T01:22:11.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
62402024-11-21T01:22:11.825ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62412024-11-21T01:22:11.825ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aad8ca42-ecbf-49dd-8814-578d891081fd", "content-length": "691", "date": "Thu, 21 Nov 2024 01:22:10 GMT"} })
62422024-11-21T01:22:11.825ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
62432024-11-21T01:22:11.825ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
62442024-11-21T01:22:11.825ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
62452024-11-21T01:22:11.826ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.040965ms iteration = 11 status = {}
62462024-11-21T01:22:11.835ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 532.744857ms iteration = 11 status = {}
62472024-11-21T01:22:11.868ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
62482024-11-21T01:22:11.869ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "194176d3-951d-4838-a697-23b1bb07fb62", "date": "Thu, 21 Nov 2024 01:22:10 GMT"} })
62492024-11-21T01:22:11.871ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
62502024-11-21T01:22:11.871ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 568.568132ms
62512024-11-21T01:22:11.871ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 568.577102ms iteration = 2 status = {}
62522024-11-21T01:22:11.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62532024-11-21T01:22:11.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62542024-11-21T01:22:11.900ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
62552024-11-21T01:22:11.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62562024-11-21T01:22:11.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62572024-11-21T01:22:11.909ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
62582024-11-21T01:22:11.910ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "abd78156-7907-4dc1-a949-1e1b55d8d26a", "content-length": "134", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
62592024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
62602024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
62612024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62622024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
62632024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62642024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62652024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62662024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62672024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
62682024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
62692024-11-21T01:22:11.910ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
62702024-11-21T01:22:11.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62712024-11-21T01:22:11.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62722024-11-21T01:22:11.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
62732024-11-21T01:22:11.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f06ba53e-1ea0-474d-9773-baa29b7f32e2", "content-length": "2", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
62742024-11-21T01:22:11.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
62752024-11-21T01:22:11.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2538f60f-8f1d-4d6b-9ef4-9469b6cef55a", "content-length": "51", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
62762024-11-21T01:22:11.913ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
62772024-11-21T01:22:11.913ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
62782024-11-21T01:22:11.998ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0446e6d8-8651-45ad-9d59-b33045d2b5c3", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
62792024-11-21T01:22:11.998ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
62802024-11-21T01:22:11.998ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
62812024-11-21T01:22:11.998ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "938e0249-3752-4735-8ed8-49b4a8d26aa3", "content-length": "682", "date": "Thu, 21 Nov 2024 01:22:11 GMT"} })
62822024-11-21T01:22:11.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62832024-11-21T01:22:11.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62842024-11-21T01:22:12.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62852024-11-21T01:22:12.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62862024-11-21T01:22:12.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62872024-11-21T01:22:12.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62882024-11-21T01:22:12.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62892024-11-21T01:22:12.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62902024-11-21T01:22:12.013ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 710.453712ms iteration = 11 status = {}
62912024-11-21T01:22:12.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6fcf82d3-4c21-445f-82de-9d41b8c94b87 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
62922024-11-21T01:22:12.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6fcf82d3-4c21-445f-82de-9d41b8c94b87 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
62932024-11-21T01:22:12.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6fcf82d3-4c21-445f-82de-9d41b8c94b87 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
62942024-11-21T01:22:13.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d0d3726c-aae1-4133-819d-3e9b53b6fd73 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
62952024-11-21T01:22:13.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d0d3726c-aae1-4133-819d-3e9b53b6fd73 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
62962024-11-21T01:22:13.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d0d3726c-aae1-4133-819d-3e9b53b6fd73 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
62972024-11-21T01:22:14.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67c8f632-8a10-4498-9fef-ee45ce62afcb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
62982024-11-21T01:22:14.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67c8f632-8a10-4498-9fef-ee45ce62afcb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
62992024-11-21T01:22:14.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67c8f632-8a10-4498-9fef-ee45ce62afcb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63002024-11-21T01:22:15.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b4617c3-8b61-4885-8423-b674b5241c0c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63012024-11-21T01:22:15.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b4617c3-8b61-4885-8423-b674b5241c0c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63022024-11-21T01:22:15.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b4617c3-8b61-4885-8423-b674b5241c0c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63032024-11-21T01:22:16.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c3b1e4e2-4cb4-4ebd-ac41-7c5c749066a1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63042024-11-21T01:22:16.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c3b1e4e2-4cb4-4ebd-ac41-7c5c749066a1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63052024-11-21T01:22:16.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c3b1e4e2-4cb4-4ebd-ac41-7c5c749066a1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63062024-11-21T01:22:17.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67220f9c-aa60-4646-bd48-122fe9034912 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63072024-11-21T01:22:17.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67220f9c-aa60-4646-bd48-122fe9034912 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63082024-11-21T01:22:17.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67220f9c-aa60-4646-bd48-122fe9034912 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63092024-11-21T01:22:18.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 524 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = bbc9f4c3-9ba3-44fe-ad5f-78845fc73325 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
63102024-11-21T01:22:18.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1466d2a7-7d83-44d4-a9bd-3c3431f5ec19 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63112024-11-21T01:22:18.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1466d2a7-7d83-44d4-a9bd-3c3431f5ec19 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63122024-11-21T01:22:18.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1466d2a7-7d83-44d4-a9bd-3c3431f5ec19 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63132024-11-21T01:22:19.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9648ff0d-8734-46ef-ade2-c7180f908914 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63142024-11-21T01:22:19.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9648ff0d-8734-46ef-ade2-c7180f908914 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63152024-11-21T01:22:19.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9648ff0d-8734-46ef-ade2-c7180f908914 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63162024-11-21T01:22:20.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8dee9b45-3ba3-42b5-b226-24d4b4116eba roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63172024-11-21T01:22:20.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8dee9b45-3ba3-42b5-b226-24d4b4116eba resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63182024-11-21T01:22:20.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8dee9b45-3ba3-42b5-b226-24d4b4116eba response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63192024-11-21T01:22:21.301ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
63202024-11-21T01:22:21.301ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63212024-11-21T01:22:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63222024-11-21T01:22:21.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
63232024-11-21T01:22:21.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63242024-11-21T01:22:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63252024-11-21T01:22:21.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63262024-11-21T01:22:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63272024-11-21T01:22:21.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63282024-11-21T01:22:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63292024-11-21T01:22:21.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63302024-11-21T01:22:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63312024-11-21T01:22:21.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63322024-11-21T01:22:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
63332024-11-21T01:22:21.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63342024-11-21T01:22:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63352024-11-21T01:22:21.320ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
63362024-11-21T01:22:21.320ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.10048ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
63372024-11-21T01:22:21.331ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63382024-11-21T01:22:21.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63392024-11-21T01:22:21.333ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.700453ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63402024-11-21T01:22:21.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce07eae5-abd4-436b-bc36-292db468df2e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63412024-11-21T01:22:21.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce07eae5-abd4-436b-bc36-292db468df2e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63422024-11-21T01:22:21.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce07eae5-abd4-436b-bc36-292db468df2e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63432024-11-21T01:22:22.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7722648e-8dc3-4a7b-9615-4b9a93180f79 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63442024-11-21T01:22:22.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7722648e-8dc3-4a7b-9615-4b9a93180f79 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63452024-11-21T01:22:22.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7722648e-8dc3-4a7b-9615-4b9a93180f79 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63462024-11-21T01:22:23.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 22eee17b-be85-481d-b626-7155c4c008df roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63472024-11-21T01:22:23.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 22eee17b-be85-481d-b626-7155c4c008df resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63482024-11-21T01:22:23.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 22eee17b-be85-481d-b626-7155c4c008df response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63492024-11-21T01:22:24.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1beddb77-345b-4600-9f6a-066e76b71c2d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63502024-11-21T01:22:24.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1beddb77-345b-4600-9f6a-066e76b71c2d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63512024-11-21T01:22:24.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1beddb77-345b-4600-9f6a-066e76b71c2d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63522024-11-21T01:22:25.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f99974d4-210f-4e17-8065-2ec6624f2a96 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63532024-11-21T01:22:25.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f99974d4-210f-4e17-8065-2ec6624f2a96 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63542024-11-21T01:22:25.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f99974d4-210f-4e17-8065-2ec6624f2a96 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63552024-11-21T01:22:26.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9117e107-39d1-4f32-9861-1d30247ca9a6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63562024-11-21T01:22:26.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9117e107-39d1-4f32-9861-1d30247ca9a6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63572024-11-21T01:22:26.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9117e107-39d1-4f32-9861-1d30247ca9a6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63582024-11-21T01:22:27.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69f7b571-77f8-47f8-b959-a8d373d9dc64 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63592024-11-21T01:22:27.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69f7b571-77f8-47f8-b959-a8d373d9dc64 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63602024-11-21T01:22:27.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69f7b571-77f8-47f8-b959-a8d373d9dc64 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63612024-11-21T01:22:28.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5aa83361-d07e-4125-885f-8878923261fe roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63622024-11-21T01:22:28.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5aa83361-d07e-4125-885f-8878923261fe resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63632024-11-21T01:22:28.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5aa83361-d07e-4125-885f-8878923261fe response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63642024-11-21T01:22:29.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9de2dd06-d93e-4072-ba16-2b92ec9324e4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63652024-11-21T01:22:29.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9de2dd06-d93e-4072-ba16-2b92ec9324e4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63662024-11-21T01:22:29.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9de2dd06-d93e-4072-ba16-2b92ec9324e4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63672024-11-21T01:22:30.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 188b7c34-5cde-49b4-8186-4504b4d34aef roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63682024-11-21T01:22:30.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 188b7c34-5cde-49b4-8186-4504b4d34aef resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63692024-11-21T01:22:30.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 188b7c34-5cde-49b4-8186-4504b4d34aef response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63702024-11-21T01:22:31.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
63712024-11-21T01:22:31.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63722024-11-21T01:22:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63732024-11-21T01:22:31.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
63742024-11-21T01:22:31.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63752024-11-21T01:22:31.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63762024-11-21T01:22:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63772024-11-21T01:22:31.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63782024-11-21T01:22:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63792024-11-21T01:22:31.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.147454ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63802024-11-21T01:22:31.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63812024-11-21T01:22:31.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63822024-11-21T01:22:31.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63832024-11-21T01:22:31.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63842024-11-21T01:22:31.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63852024-11-21T01:22:31.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63862024-11-21T01:22:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
63872024-11-21T01:22:31.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63882024-11-21T01:22:31.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63892024-11-21T01:22:31.321ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
63902024-11-21T01:22:31.321ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.110879ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
63912024-11-21T01:22:31.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b2002dd3-50ca-4871-aabc-7e66374311ba roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63922024-11-21T01:22:31.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b2002dd3-50ca-4871-aabc-7e66374311ba resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63932024-11-21T01:22:31.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b2002dd3-50ca-4871-aabc-7e66374311ba response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63942024-11-21T01:22:32.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce3b6fe2-4da1-4d9b-9272-ee14af2833e7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63952024-11-21T01:22:32.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce3b6fe2-4da1-4d9b-9272-ee14af2833e7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63962024-11-21T01:22:32.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce3b6fe2-4da1-4d9b-9272-ee14af2833e7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63972024-11-21T01:22:33.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 587 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 0f3aca34-443c-430d-b8cc-ff252ff6e6a6 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
63982024-11-21T01:22:33.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 50507257-2eea-4645-83a6-5a56ebff5d3d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
63992024-11-21T01:22:33.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 50507257-2eea-4645-83a6-5a56ebff5d3d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64002024-11-21T01:22:33.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 50507257-2eea-4645-83a6-5a56ebff5d3d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64012024-11-21T01:22:34.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86afa40d-cc80-4ddc-88f2-48f571c1a62f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64022024-11-21T01:22:34.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86afa40d-cc80-4ddc-88f2-48f571c1a62f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64032024-11-21T01:22:34.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86afa40d-cc80-4ddc-88f2-48f571c1a62f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64042024-11-21T01:22:35.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7335d387-80b6-46b9-94fc-f72f7bbf7144 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64052024-11-21T01:22:35.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7335d387-80b6-46b9-94fc-f72f7bbf7144 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64062024-11-21T01:22:35.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7335d387-80b6-46b9-94fc-f72f7bbf7144 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64072024-11-21T01:22:36.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ca76794f-3abc-41cb-87c6-b593f9f9e78e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64082024-11-21T01:22:36.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ca76794f-3abc-41cb-87c6-b593f9f9e78e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64092024-11-21T01:22:36.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ca76794f-3abc-41cb-87c6-b593f9f9e78e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64102024-11-21T01:22:37.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d16e5e52-b336-4fec-845e-1787461b9afe roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64112024-11-21T01:22:37.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d16e5e52-b336-4fec-845e-1787461b9afe resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64122024-11-21T01:22:37.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d16e5e52-b336-4fec-845e-1787461b9afe response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64132024-11-21T01:22:38.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2ae22cdf-3cc1-4234-beb8-da827d87cff2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64142024-11-21T01:22:38.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2ae22cdf-3cc1-4234-beb8-da827d87cff2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64152024-11-21T01:22:38.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2ae22cdf-3cc1-4234-beb8-da827d87cff2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64162024-11-21T01:22:39.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3e1fd1f3-1511-43dd-ad06-0f667d6d707a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64172024-11-21T01:22:39.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3e1fd1f3-1511-43dd-ad06-0f667d6d707a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64182024-11-21T01:22:39.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3e1fd1f3-1511-43dd-ad06-0f667d6d707a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64192024-11-21T01:22:40.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 22243c8d-db78-4c6d-b4f5-9cd421c19687 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64202024-11-21T01:22:40.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 22243c8d-db78-4c6d-b4f5-9cd421c19687 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64212024-11-21T01:22:40.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 22243c8d-db78-4c6d-b4f5-9cd421c19687 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64222024-11-21T01:22:40.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 80dc34af-8212-48d5-8d77-21a2f1c9425b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64232024-11-21T01:22:40.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 80dc34af-8212-48d5-8d77-21a2f1c9425b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64242024-11-21T01:22:40.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 80dc34af-8212-48d5-8d77-21a2f1c9425b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
64252024-11-21T01:22:41.301ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
64262024-11-21T01:22:41.301ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
64272024-11-21T01:22:41.301ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64282024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64292024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
64302024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64312024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
64322024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
64332024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64342024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64352024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
64362024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64372024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
64382024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
64392024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
64402024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64412024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64422024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64432024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64442024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64452024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64462024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64472024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64482024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64492024-11-21T01:22:41.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64502024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
64512024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
64522024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64532024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64542024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64552024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
64562024-11-21T01:22:41.303ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64572024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
64582024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64592024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64602024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64612024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64622024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64632024-11-21T01:22:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64642024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
64652024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64662024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
64672024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
64682024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
64692024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
64702024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
64712024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
64722024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
64732024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64742024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
64752024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64762024-11-21T01:22:41.304ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.646098ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64772024-11-21T01:22:41.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1340, tv_nsec: 203418707 } })
64782024-11-21T01:22:41.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1340, tv_nsec: 203627280 } })
64792024-11-21T01:22:41.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
64802024-11-21T01:22:41.305ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
64812024-11-21T01:22:41.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64822024-11-21T01:22:41.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64832024-11-21T01:22:41.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64842024-11-21T01:22:41.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64852024-11-21T01:22:41.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64862024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64872024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64882024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64892024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64902024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64912024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64922024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64932024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64942024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64952024-11-21T01:22:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64962024-11-21T01:22:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64972024-11-21T01:22:41.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64982024-11-21T01:22:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64992024-11-21T01:22:41.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65002024-11-21T01:22:41.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65012024-11-21T01:22:41.312ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65022024-11-21T01:22:41.312ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65032024-11-21T01:22:41.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65042024-11-21T01:22:41.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65052024-11-21T01:22:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65062024-11-21T01:22:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65072024-11-21T01:22:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
65082024-11-21T01:22:41.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65092024-11-21T01:22:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65102024-11-21T01:22:41.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65112024-11-21T01:22:41.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65122024-11-21T01:22:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65132024-11-21T01:22:41.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.60352ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
65142024-11-21T01:22:41.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65152024-11-21T01:22:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65162024-11-21T01:22:41.316ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65172024-11-21T01:22:41.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65182024-11-21T01:22:41.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.564375ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65192024-11-21T01:22:41.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65202024-11-21T01:22:41.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65212024-11-21T01:22:41.317ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1340, tv_nsec: 216086596 } })
65222024-11-21T01:22:41.318ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
65232024-11-21T01:22:41.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65242024-11-21T01:22:41.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65252024-11-21T01:22:41.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.363217ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65262024-11-21T01:22:41.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65272024-11-21T01:22:41.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65282024-11-21T01:22:41.318ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65292024-11-21T01:22:41.318ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65302024-11-21T01:22:41.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65312024-11-21T01:22:41.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65322024-11-21T01:22:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65332024-11-21T01:22:41.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65342024-11-21T01:22:41.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65352024-11-21T01:22:41.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65362024-11-21T01:22:41.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65372024-11-21T01:22:41.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65382024-11-21T01:22:41.323ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65392024-11-21T01:22:41.323ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65402024-11-21T01:22:41.323ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 20.395487ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65412024-11-21T01:22:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
65422024-11-21T01:22:41.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65432024-11-21T01:22:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
65442024-11-21T01:22:41.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65452024-11-21T01:22:41.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65462024-11-21T01:22:41.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65472024-11-21T01:22:41.336ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
65482024-11-21T01:22:41.336ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.685888ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
65492024-11-21T01:22:41.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65502024-11-21T01:22:41.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65512024-11-21T01:22:41.347ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65522024-11-21T01:22:41.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65532024-11-21T01:22:41.355ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
65542024-11-21T01:22:41.355ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.186775ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
65552024-11-21T01:22:41.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65562024-11-21T01:22:41.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65572024-11-21T01:22:41.401ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
65582024-11-21T01:22:41.402ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65592024-11-21T01:22:41.402ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "248d5452-cb7f-4521-848a-813c4c87795f", "content-length": "26", "date": "Thu, 21 Nov 2024 01:22:40 GMT"} })
65602024-11-21T01:22:41.402ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65612024-11-21T01:22:41.403ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65622024-11-21T01:22:41.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65632024-11-21T01:22:41.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65642024-11-21T01:22:41.427ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.419958ms iteration = 14 status = {"physical_disks_added":0}
65652024-11-21T01:22:41.450ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65662024-11-21T01:22:41.450ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65672024-11-21T01:22:41.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 147.084063ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
65682024-11-21T01:22:41.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65692024-11-21T01:22:41.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65702024-11-21T01:22:41.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65712024-11-21T01:22:41.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65722024-11-21T01:22:41.454ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65732024-11-21T01:22:41.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65742024-11-21T01:22:41.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65752024-11-21T01:22:41.456ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65762024-11-21T01:22:41.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65772024-11-21T01:22:41.458ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65782024-11-21T01:22:41.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65792024-11-21T01:22:41.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
65802024-11-21T01:22:41.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65812024-11-21T01:22:41.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65822024-11-21T01:22:41.461ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 159.128922ms iteration = 12 status = 0
65832024-11-21T01:22:41.483ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
65842024-11-21T01:22:41.483ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65852024-11-21T01:22:41.483ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcc4ed9b-bc51-447d-bed5-0940f02d0a85", "content-length": "26", "date": "Thu, 21 Nov 2024 01:22:41 GMT"} })
65862024-11-21T01:22:41.483ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65872024-11-21T01:22:41.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 180.016997ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
65882024-11-21T01:22:41.485ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65892024-11-21T01:22:41.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 181.534558ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
65902024-11-21T01:22:41.494ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
65912024-11-21T01:22:41.494ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65922024-11-21T01:22:41.494ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "52e8d101-3873-4295-935f-ab3dbeae605d", "content-length": "26", "date": "Thu, 21 Nov 2024 01:22:41 GMT"} })
65932024-11-21T01:22:41.494ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65942024-11-21T01:22:41.496ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
65952024-11-21T01:22:41.498ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 196.265226ms iteration = 12 status = {}
65962024-11-21T01:22:41.536ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65972024-11-21T01:22:41.536ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "153f661d-9853-4046-991f-9217600399fe", "content-length": "1", "date": "Thu, 21 Nov 2024 01:22:40 GMT"} })
65982024-11-21T01:22:41.538ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65992024-11-21T01:22:41.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66002024-11-21T01:22:41.542ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3efdac56-1a17-41e4-800f-a8f6edc68198", "content-length": "372", "date": "Thu, 21 Nov 2024 01:22:40 GMT"} })
66012024-11-21T01:22:41.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66022024-11-21T01:22:41.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66032024-11-21T01:22:41.587ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66042024-11-21T01:22:41.587ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7966e395-2def-45dd-90b2-decb4378c4bb", "content-length": "691", "date": "Thu, 21 Nov 2024 01:22:41 GMT"} })
66052024-11-21T01:22:41.587ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
66062024-11-21T01:22:41.587ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
66072024-11-21T01:22:41.587ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
66082024-11-21T01:22:41.588ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 286.831222ms iteration = 12 status = {}
66092024-11-21T01:22:41.589ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 287.260028ms iteration = 12 status = null
66102024-11-21T01:22:41.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66112024-11-21T01:22:41.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66122024-11-21T01:22:41.630ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
66132024-11-21T01:22:41.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66142024-11-21T01:22:41.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66152024-11-21T01:22:41.639ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
66162024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
66172024-11-21T01:22:41.639ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66182024-11-21T01:22:41.639ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "59d22f31-ba86-4b56-8a5f-1cf8036b5c69", "content-length": "134", "date": "Thu, 21 Nov 2024 01:22:40 GMT"} })
66192024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
66202024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
66212024-11-21T01:22:41.639ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "82be8c03-fca4-4f45-9d4c-9bacdd11ec06", "date": "Thu, 21 Nov 2024 01:22:41 GMT"} })
66222024-11-21T01:22:41.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66232024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
66242024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66252024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66262024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66272024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66282024-11-21T01:22:41.639ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66292024-11-21T01:22:41.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66302024-11-21T01:22:41.640ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66312024-11-21T01:22:41.640ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66322024-11-21T01:22:41.640ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
66332024-11-21T01:22:41.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66342024-11-21T01:22:41.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66352024-11-21T01:22:41.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66362024-11-21T01:22:41.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66372024-11-21T01:22:41.642ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
66382024-11-21T01:22:41.642ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e4d709d-1671-4dda-91e1-5b2ecb33c68d", "content-length": "2", "date": "Thu, 21 Nov 2024 01:22:40 GMT"} })
66392024-11-21T01:22:41.642ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
66402024-11-21T01:22:41.642ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "62e2bdc3-7bdd-4880-9b54-9ddb5013fb65", "content-length": "51", "date": "Thu, 21 Nov 2024 01:22:40 GMT"} })
66412024-11-21T01:22:41.642ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
66422024-11-21T01:22:41.642ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66432024-11-21T01:22:41.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66442024-11-21T01:22:41.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66452024-11-21T01:22:41.648ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66462024-11-21T01:22:41.648ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66472024-11-21T01:22:41.739ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dd19c06a-f6a0-4b6e-8fd0-ed92eae3fe21", "date": "Thu, 21 Nov 2024 01:22:41 GMT"} })
66482024-11-21T01:22:41.740ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
66492024-11-21T01:22:41.740ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66502024-11-21T01:22:41.740ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "78c16633-9074-4082-b265-98c33d5ca2d8", "content-length": "682", "date": "Thu, 21 Nov 2024 01:22:40 GMT"} })
66512024-11-21T01:22:41.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66522024-11-21T01:22:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66532024-11-21T01:22:41.740ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cdbd5863-82c7-4671-afa1-e453faabccb9", "date": "Thu, 21 Nov 2024 01:22:41 GMT"} })
66542024-11-21T01:22:41.741ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 438.836654ms iteration = 12 status = {}
66552024-11-21T01:22:41.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66562024-11-21T01:22:41.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66572024-11-21T01:22:41.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66582024-11-21T01:22:41.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66592024-11-21T01:22:41.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66602024-11-21T01:22:41.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66612024-11-21T01:22:41.757ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 455.528939ms iteration = 12 status = {}
66622024-11-21T01:22:42.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ccafd16a-5bf2-485b-8cef-c4a3c359c583 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66632024-11-21T01:22:42.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ccafd16a-5bf2-485b-8cef-c4a3c359c583 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66642024-11-21T01:22:42.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ccafd16a-5bf2-485b-8cef-c4a3c359c583 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66652024-11-21T01:22:43.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a0e6184-c2e7-488f-a0cb-fa9db78495f2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66662024-11-21T01:22:43.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a0e6184-c2e7-488f-a0cb-fa9db78495f2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66672024-11-21T01:22:43.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a0e6184-c2e7-488f-a0cb-fa9db78495f2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66682024-11-21T01:22:44.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 193d97ba-34ed-4c27-9ab4-b55db7b14e66 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66692024-11-21T01:22:44.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 193d97ba-34ed-4c27-9ab4-b55db7b14e66 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66702024-11-21T01:22:44.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 193d97ba-34ed-4c27-9ab4-b55db7b14e66 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66712024-11-21T01:22:45.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8320d5c5-8791-4b45-9049-afe72e65a8ae roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66722024-11-21T01:22:45.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8320d5c5-8791-4b45-9049-afe72e65a8ae resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66732024-11-21T01:22:45.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8320d5c5-8791-4b45-9049-afe72e65a8ae response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66742024-11-21T01:22:46.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05c4ffed-cecb-4296-be14-8def2c56dd5b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66752024-11-21T01:22:46.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05c4ffed-cecb-4296-be14-8def2c56dd5b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66762024-11-21T01:22:46.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05c4ffed-cecb-4296-be14-8def2c56dd5b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66772024-11-21T01:22:47.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 665bdf76-2672-4cc7-8f5d-77014bc8e52f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66782024-11-21T01:22:47.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 665bdf76-2672-4cc7-8f5d-77014bc8e52f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66792024-11-21T01:22:47.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 665bdf76-2672-4cc7-8f5d-77014bc8e52f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66802024-11-21T01:22:48.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69d72609-9395-45a1-a9fa-f2daddec2558 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66812024-11-21T01:22:48.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69d72609-9395-45a1-a9fa-f2daddec2558 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66822024-11-21T01:22:48.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69d72609-9395-45a1-a9fa-f2daddec2558 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66832024-11-21T01:22:48.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 515 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 0848e64c-576a-4515-8101-8965bb475ea8 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
66842024-11-21T01:22:49.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45a4ee48-51ae-4a46-a15f-fd86f557f3a1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66852024-11-21T01:22:49.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45a4ee48-51ae-4a46-a15f-fd86f557f3a1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66862024-11-21T01:22:49.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45a4ee48-51ae-4a46-a15f-fd86f557f3a1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66872024-11-21T01:22:50.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f14a9edb-f8fd-4b41-a95d-7854694ef49d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66882024-11-21T01:22:50.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f14a9edb-f8fd-4b41-a95d-7854694ef49d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66892024-11-21T01:22:50.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f14a9edb-f8fd-4b41-a95d-7854694ef49d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66902024-11-21T01:22:51.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52defd3c-ef02-429c-b69c-0afb34688c9d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66912024-11-21T01:22:51.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52defd3c-ef02-429c-b69c-0afb34688c9d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66922024-11-21T01:22:51.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 52defd3c-ef02-429c-b69c-0afb34688c9d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
66932024-11-21T01:22:51.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
66942024-11-21T01:22:51.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66952024-11-21T01:22:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66962024-11-21T01:22:51.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
66972024-11-21T01:22:51.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66982024-11-21T01:22:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66992024-11-21T01:22:51.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67002024-11-21T01:22:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67012024-11-21T01:22:51.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67022024-11-21T01:22:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67032024-11-21T01:22:51.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67042024-11-21T01:22:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67052024-11-21T01:22:51.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67062024-11-21T01:22:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
67072024-11-21T01:22:51.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67082024-11-21T01:22:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67092024-11-21T01:22:51.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
67102024-11-21T01:22:51.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.895259ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
67112024-11-21T01:22:51.335ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67122024-11-21T01:22:51.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67132024-11-21T01:22:51.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.904683ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67142024-11-21T01:22:52.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b14fef66-4ad1-4e33-906f-4c6a1b42cd87 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67152024-11-21T01:22:52.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b14fef66-4ad1-4e33-906f-4c6a1b42cd87 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67162024-11-21T01:22:52.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b14fef66-4ad1-4e33-906f-4c6a1b42cd87 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67172024-11-21T01:22:53.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0ac5eeee-abf0-46f0-ac02-440be8bb0978 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67182024-11-21T01:22:53.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0ac5eeee-abf0-46f0-ac02-440be8bb0978 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67192024-11-21T01:22:53.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0ac5eeee-abf0-46f0-ac02-440be8bb0978 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67202024-11-21T01:22:54.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb98d3ba-6fd2-44e3-b4ca-2f8acd5c96cf roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67212024-11-21T01:22:54.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb98d3ba-6fd2-44e3-b4ca-2f8acd5c96cf resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67222024-11-21T01:22:54.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb98d3ba-6fd2-44e3-b4ca-2f8acd5c96cf response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67232024-11-21T01:22:55.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e0473b6-874d-42bb-94bf-a45026648215 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67242024-11-21T01:22:55.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e0473b6-874d-42bb-94bf-a45026648215 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67252024-11-21T01:22:55.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e0473b6-874d-42bb-94bf-a45026648215 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67262024-11-21T01:22:56.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa2ed365-9e03-40c8-9e22-ba69465d4797 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67272024-11-21T01:22:56.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa2ed365-9e03-40c8-9e22-ba69465d4797 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67282024-11-21T01:22:56.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fa2ed365-9e03-40c8-9e22-ba69465d4797 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67292024-11-21T01:22:57.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6c887d60-0555-47e4-9eb6-815757266c3f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67302024-11-21T01:22:57.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6c887d60-0555-47e4-9eb6-815757266c3f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67312024-11-21T01:22:57.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6c887d60-0555-47e4-9eb6-815757266c3f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67322024-11-21T01:22:58.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f473eac8-8779-4253-8eec-c03f24947b41 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67332024-11-21T01:22:58.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f473eac8-8779-4253-8eec-c03f24947b41 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67342024-11-21T01:22:58.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f473eac8-8779-4253-8eec-c03f24947b41 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67352024-11-21T01:22:59.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8af3e81f-7fa0-40e3-9778-1cf6c71a769b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67362024-11-21T01:22:59.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8af3e81f-7fa0-40e3-9778-1cf6c71a769b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67372024-11-21T01:22:59.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8af3e81f-7fa0-40e3-9778-1cf6c71a769b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67382024-11-21T01:23:00.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 77b3891b-aab5-47b3-a7a5-5941cbe4e04c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67392024-11-21T01:23:00.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 77b3891b-aab5-47b3-a7a5-5941cbe4e04c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67402024-11-21T01:23:00.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 77b3891b-aab5-47b3-a7a5-5941cbe4e04c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67412024-11-21T01:23:01.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
67422024-11-21T01:23:01.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67432024-11-21T01:23:01.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67442024-11-21T01:23:01.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
67452024-11-21T01:23:01.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67462024-11-21T01:23:01.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67472024-11-21T01:23:01.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67482024-11-21T01:23:01.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67492024-11-21T01:23:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67502024-11-21T01:23:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67512024-11-21T01:23:01.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67522024-11-21T01:23:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67532024-11-21T01:23:01.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.55343ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67542024-11-21T01:23:01.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67552024-11-21T01:23:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67562024-11-21T01:23:01.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67572024-11-21T01:23:01.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
67582024-11-21T01:23:01.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67592024-11-21T01:23:01.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67602024-11-21T01:23:01.321ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
67612024-11-21T01:23:01.321ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.062909ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
67622024-11-21T01:23:01.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0467d47c-301a-45d1-b2f8-3869e36f2748 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67632024-11-21T01:23:01.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0467d47c-301a-45d1-b2f8-3869e36f2748 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67642024-11-21T01:23:01.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0467d47c-301a-45d1-b2f8-3869e36f2748 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67652024-11-21T01:23:02.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69ce2676-1c62-46eb-b8b3-b2f4dbf56135 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67662024-11-21T01:23:02.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69ce2676-1c62-46eb-b8b3-b2f4dbf56135 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67672024-11-21T01:23:02.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 69ce2676-1c62-46eb-b8b3-b2f4dbf56135 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67682024-11-21T01:23:03.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 575 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 83429e52-11f3-4828-a2ae-d2b0e508cc57 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
67692024-11-21T01:23:03.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 89379ae7-60d6-4196-b992-290242952fe4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67702024-11-21T01:23:03.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 89379ae7-60d6-4196-b992-290242952fe4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67712024-11-21T01:23:03.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 89379ae7-60d6-4196-b992-290242952fe4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67722024-11-21T01:23:04.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc0dc4f2-714e-49b0-a459-ce5b0b9cb153 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67732024-11-21T01:23:04.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc0dc4f2-714e-49b0-a459-ce5b0b9cb153 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67742024-11-21T01:23:04.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc0dc4f2-714e-49b0-a459-ce5b0b9cb153 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67752024-11-21T01:23:05.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 33318050-84a8-4918-9812-12a2e46aff67 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67762024-11-21T01:23:05.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 33318050-84a8-4918-9812-12a2e46aff67 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67772024-11-21T01:23:05.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 33318050-84a8-4918-9812-12a2e46aff67 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67782024-11-21T01:23:06.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 164de85c-5f5e-448e-a349-0cadb4bc99dd roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67792024-11-21T01:23:06.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 164de85c-5f5e-448e-a349-0cadb4bc99dd resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67802024-11-21T01:23:06.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 164de85c-5f5e-448e-a349-0cadb4bc99dd response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67812024-11-21T01:23:07.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af3eddc2-b024-417d-8613-39265ec6a913 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67822024-11-21T01:23:07.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af3eddc2-b024-417d-8613-39265ec6a913 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67832024-11-21T01:23:07.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af3eddc2-b024-417d-8613-39265ec6a913 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67842024-11-21T01:23:08.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3ccc7ced-ed44-40a9-b966-4074d70cf77a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67852024-11-21T01:23:08.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3ccc7ced-ed44-40a9-b966-4074d70cf77a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67862024-11-21T01:23:08.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3ccc7ced-ed44-40a9-b966-4074d70cf77a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67872024-11-21T01:23:09.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 06bbc846-a46c-4ff7-aae6-6cabf24f1def roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67882024-11-21T01:23:09.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 06bbc846-a46c-4ff7-aae6-6cabf24f1def resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67892024-11-21T01:23:09.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 06bbc846-a46c-4ff7-aae6-6cabf24f1def response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67902024-11-21T01:23:10.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a4fbd874-033e-4655-8160-24fcf925a592 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67912024-11-21T01:23:10.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a4fbd874-033e-4655-8160-24fcf925a592 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67922024-11-21T01:23:10.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a4fbd874-033e-4655-8160-24fcf925a592 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
67932024-11-21T01:23:10.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 1695a397-8753-4c39-8652-1dfed00dfc04 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
67942024-11-21T01:23:10.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 1695a397-8753-4c39-8652-1dfed00dfc04 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
67952024-11-21T01:23:10.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 1695a397-8753-4c39-8652-1dfed00dfc04 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
67962024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
67972024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
67982024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
67992024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68002024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68012024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
68022024-11-21T01:23:11.302ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
68032024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
68042024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
68052024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68062024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
68072024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
68082024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
68092024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68102024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68112024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
68122024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
68132024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
68142024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68152024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
68162024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
68172024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
68182024-11-21T01:23:11.302ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
68192024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68202024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.411\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
68212024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
68222024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
68232024-11-21T01:23:11.302ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
68242024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68252024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68262024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
68272024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
68282024-11-21T01:23:11.303ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:13:11.302937805 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
68292024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
68302024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68312024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
68322024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68332024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
68342024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
68352024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68362024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
68372024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68382024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68392024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
68402024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
68412024-11-21T01:23:11.303ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68422024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68432024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
68442024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68452024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
68462024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68472024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68482024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
68492024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68502024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68512024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68522024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68532024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68542024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
68552024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68562024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68572024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68582024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
68592024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68602024-11-21T01:23:11.303ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 201637562 } })
68612024-11-21T01:23:11.303ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 201639202 } })
68622024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68632024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68642024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68652024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68662024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68672024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68682024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68692024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68702024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68712024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68722024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68732024-11-21T01:23:11.303ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68742024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68752024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68762024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
68772024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
68782024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
68792024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
68802024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68812024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
68822024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
68832024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68842024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68852024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
68862024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
68872024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
68882024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68892024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
68902024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.43222ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
68912024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
68922024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.567382ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
68932024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
68942024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68952024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
68962024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
68972024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
68982024-11-21T01:23:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68992024-11-21T01:23:11.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69002024-11-21T01:23:11.307ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69012024-11-21T01:23:11.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69022024-11-21T01:23:11.307ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.819918ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69032024-11-21T01:23:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
69042024-11-21T01:23:11.309ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69052024-11-21T01:23:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69062024-11-21T01:23:11.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69072024-11-21T01:23:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
69082024-11-21T01:23:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69092024-11-21T01:23:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69102024-11-21T01:23:11.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69112024-11-21T01:23:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69122024-11-21T01:23:11.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69132024-11-21T01:23:11.312ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 210369445 } })
69142024-11-21T01:23:11.312ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69152024-11-21T01:23:11.312ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
69162024-11-21T01:23:11.312ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:13:11.302937805 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
69172024-11-21T01:23:11.312ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.92184ms iteration = 7 status = {"expiration":"2024-11-21T01:13:11.302937805Z","pruned":[]}
69182024-11-21T01:23:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69192024-11-21T01:23:11.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69202024-11-21T01:23:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69212024-11-21T01:23:11.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69222024-11-21T01:23:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69232024-11-21T01:23:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69242024-11-21T01:23:11.315ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69252024-11-21T01:23:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69262024-11-21T01:23:11.317ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69272024-11-21T01:23:11.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282024-11-21T01:23:11.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69292024-11-21T01:23:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69302024-11-21T01:23:11.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69312024-11-21T01:23:11.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69322024-11-21T01:23:11.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69332024-11-21T01:23:11.321ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69342024-11-21T01:23:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69352024-11-21T01:23:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69362024-11-21T01:23:11.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69372024-11-21T01:23:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69382024-11-21T01:23:11.322ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69392024-11-21T01:23:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69402024-11-21T01:23:11.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69412024-11-21T01:23:11.325ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69422024-11-21T01:23:11.325ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 223764374 } })
69432024-11-21T01:23:11.325ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
69442024-11-21T01:23:11.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69452024-11-21T01:23:11.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69462024-11-21T01:23:11.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69472024-11-21T01:23:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69482024-11-21T01:23:11.327ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69492024-11-21T01:23:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69502024-11-21T01:23:11.329ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69512024-11-21T01:23:11.330ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 26.312031ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
69522024-11-21T01:23:11.330ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.402852ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
69532024-11-21T01:23:11.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69542024-11-21T01:23:11.331ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69552024-11-21T01:23:11.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69562024-11-21T01:23:11.335ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69572024-11-21T01:23:11.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69582024-11-21T01:23:11.335ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1370, tv_nsec: 233644063 } })
69592024-11-21T01:23:11.335ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
69602024-11-21T01:23:11.336ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69612024-11-21T01:23:11.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69622024-11-21T01:23:11.338ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69632024-11-21T01:23:11.339ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69642024-11-21T01:23:11.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69652024-11-21T01:23:11.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69662024-11-21T01:23:11.378ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
69672024-11-21T01:23:11.378ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
69682024-11-21T01:23:11.378ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.778464ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
69692024-11-21T01:23:11.380ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69702024-11-21T01:23:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69712024-11-21T01:23:11.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69722024-11-21T01:23:11.381ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69732024-11-21T01:23:11.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69742024-11-21T01:23:11.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 78.837751ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
69752024-11-21T01:23:11.383ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69762024-11-21T01:23:11.383ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69772024-11-21T01:23:11.383ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69782024-11-21T01:23:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69792024-11-21T01:23:11.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69802024-11-21T01:23:11.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69812024-11-21T01:23:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69822024-11-21T01:23:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69832024-11-21T01:23:11.384ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69842024-11-21T01:23:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69852024-11-21T01:23:11.384ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69862024-11-21T01:23:11.386ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69872024-11-21T01:23:11.386ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69882024-11-21T01:23:11.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69892024-11-21T01:23:11.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69902024-11-21T01:23:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
69912024-11-21T01:23:11.387ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69922024-11-21T01:23:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
69932024-11-21T01:23:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69942024-11-21T01:23:11.389ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69952024-11-21T01:23:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69962024-11-21T01:23:11.390ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
69972024-11-21T01:23:11.390ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
69982024-11-21T01:23:11.390ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.479523ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
69992024-11-21T01:23:11.390ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.719946ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70002024-11-21T01:23:11.390ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70012024-11-21T01:23:11.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70022024-11-21T01:23:11.392ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70032024-11-21T01:23:11.392ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70042024-11-21T01:23:11.392ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70052024-11-21T01:23:11.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70062024-11-21T01:23:11.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70072024-11-21T01:23:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
70082024-11-21T01:23:11.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70092024-11-21T01:23:11.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70102024-11-21T01:23:11.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
70112024-11-21T01:23:11.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70122024-11-21T01:23:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70132024-11-21T01:23:11.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70142024-11-21T01:23:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70152024-11-21T01:23:11.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70162024-11-21T01:23:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70172024-11-21T01:23:11.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70182024-11-21T01:23:11.404ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 101.266757ms iteration = 4 status = {"nsuccess":5}
70192024-11-21T01:23:11.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.102795ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70202024-11-21T01:23:11.414ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
70212024-11-21T01:23:11.414ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.282038ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
70222024-11-21T01:23:11.417ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70232024-11-21T01:23:11.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70242024-11-21T01:23:11.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70252024-11-21T01:23:11.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70262024-11-21T01:23:11.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70272024-11-21T01:23:11.426ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
70282024-11-21T01:23:11.426ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
70292024-11-21T01:23:11.426ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
70302024-11-21T01:23:11.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70312024-11-21T01:23:11.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70322024-11-21T01:23:11.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70332024-11-21T01:23:11.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70342024-11-21T01:23:11.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70352024-11-21T01:23:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
70362024-11-21T01:23:11.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70372024-11-21T01:23:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70382024-11-21T01:23:11.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70392024-11-21T01:23:11.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70402024-11-21T01:23:11.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70412024-11-21T01:23:11.433ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 130.322446ms iteration = 13 status = 0
70422024-11-21T01:23:11.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.309812ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70432024-11-21T01:23:11.434ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
70442024-11-21T01:23:11.434ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
70452024-11-21T01:23:11.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70462024-11-21T01:23:11.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70472024-11-21T01:23:11.434ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
70482024-11-21T01:23:11.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70492024-11-21T01:23:11.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70502024-11-21T01:23:11.441ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
70512024-11-21T01:23:11.441ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
70522024-11-21T01:23:11.441ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
70532024-11-21T01:23:11.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70542024-11-21T01:23:11.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70552024-11-21T01:23:11.448ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70562024-11-21T01:23:11.448ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70572024-11-21T01:23:11.448ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.51815ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70582024-11-21T01:23:11.448ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
70592024-11-21T01:23:11.448ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70602024-11-21T01:23:11.449ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70612024-11-21T01:23:11.449ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 145.941067ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70622024-11-21T01:23:11.449ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f44bfccf-76a0-44f5-9145-285691edf1e2", "content-length": "26", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
70632024-11-21T01:23:11.449ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70642024-11-21T01:23:11.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70652024-11-21T01:23:11.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70662024-11-21T01:23:11.450ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70672024-11-21T01:23:11.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70682024-11-21T01:23:11.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70692024-11-21T01:23:11.451ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70702024-11-21T01:23:11.453ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70712024-11-21T01:23:11.453ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70722024-11-21T01:23:11.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70732024-11-21T01:23:11.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70742024-11-21T01:23:11.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70752024-11-21T01:23:11.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70762024-11-21T01:23:11.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70772024-11-21T01:23:11.462ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70782024-11-21T01:23:11.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70792024-11-21T01:23:11.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70802024-11-21T01:23:11.467ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70812024-11-21T01:23:11.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70822024-11-21T01:23:11.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70832024-11-21T01:23:11.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70842024-11-21T01:23:11.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
70852024-11-21T01:23:11.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70862024-11-21T01:23:11.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70872024-11-21T01:23:11.474ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
70882024-11-21T01:23:11.474ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
70892024-11-21T01:23:11.474ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
70902024-11-21T01:23:11.474ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 171.446507ms iteration = 7 status = {"generation":2}
70912024-11-21T01:23:11.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 181.242525ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70922024-11-21T01:23:11.489ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
70932024-11-21T01:23:11.489ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70942024-11-21T01:23:11.490ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fe1a13a-eeea-4e2a-a525-7ab04605d851", "content-length": "26", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
70952024-11-21T01:23:11.490ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70962024-11-21T01:23:11.492ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
70972024-11-21T01:23:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70982024-11-21T01:23:11.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
70992024-11-21T01:23:11.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71002024-11-21T01:23:11.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71012024-11-21T01:23:11.499ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
71022024-11-21T01:23:11.499ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
71032024-11-21T01:23:11.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71042024-11-21T01:23:11.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71052024-11-21T01:23:11.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71062024-11-21T01:23:11.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71072024-11-21T01:23:11.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71082024-11-21T01:23:11.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71092024-11-21T01:23:11.507ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
71102024-11-21T01:23:11.507ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 204.420291ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
71112024-11-21T01:23:11.519ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
71122024-11-21T01:23:11.519ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 216.295338ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
71132024-11-21T01:23:11.529ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.13637ms iteration = 15 status = {"physical_disks_added":0}
71142024-11-21T01:23:11.556ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71152024-11-21T01:23:11.625ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
71162024-11-21T01:23:11.625ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71172024-11-21T01:23:11.625ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f4cd33e-3e7a-4986-90b3-2db15e4dcac1", "content-length": "26", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
71182024-11-21T01:23:11.625ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71192024-11-21T01:23:11.627ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71202024-11-21T01:23:11.650ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71212024-11-21T01:23:11.651ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e3c353cb-e2d8-4276-8b44-37c7162a4ac8", "date": "Thu, 21 Nov 2024 01:23:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71222024-11-21T01:23:11.651ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71232024-11-21T01:23:11.652ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d3960ded-41de-493b-af84-7e9b6753ad6a", "date": "Thu, 21 Nov 2024 01:23:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71242024-11-21T01:23:11.653ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71252024-11-21T01:23:11.654ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
71262024-11-21T01:23:11.654ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 351.833788ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
71272024-11-21T01:23:11.713ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71282024-11-21T01:23:11.714ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fa00fa5-c346-435a-a93d-81e7d68d374f", "content-length": "1", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
71292024-11-21T01:23:11.714ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71302024-11-21T01:23:11.714ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71312024-11-21T01:23:11.716ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71322024-11-21T01:23:11.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71332024-11-21T01:23:11.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e5273082-1830-4807-b3ec-40a3bb2bd449 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
71342024-11-21T01:23:11.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e5273082-1830-4807-b3ec-40a3bb2bd449 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
71352024-11-21T01:23:11.717ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e5bbd6f-3c4e-4e3d-9122-dfec947ee9ad", "content-length": "372", "date": "Thu, 21 Nov 2024 01:23:10 GMT"} })
71362024-11-21T01:23:11.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71372024-11-21T01:23:11.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71382024-11-21T01:23:11.756ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
71392024-11-21T01:23:11.757ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 455.047253ms iteration = 13 status = {}
71402024-11-21T01:23:11.761ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71412024-11-21T01:23:11.762ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1eb48f4a-f597-414c-b745-a6c01f3a8dc3", "content-length": "691", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
71422024-11-21T01:23:11.762ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
71432024-11-21T01:23:11.762ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
71442024-11-21T01:23:11.762ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
71452024-11-21T01:23:11.763ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 460.937976ms iteration = 13 status = {}
71462024-11-21T01:23:11.763ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 461.029987ms iteration = 13 status = null
71472024-11-21T01:23:11.764ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
71482024-11-21T01:23:11.764ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
71492024-11-21T01:23:11.764ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
71502024-11-21T01:23:11.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 461.448902ms iteration = 7 status = {"generation":1}
71512024-11-21T01:23:11.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e5273082-1830-4807-b3ec-40a3bb2bd449 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
71522024-11-21T01:23:11.795ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
71532024-11-21T01:23:11.796ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7e523b17-fe17-49b6-9ab5-31d15b197152", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71542024-11-21T01:23:11.796ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71552024-11-21T01:23:11.797ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e2196c49-684e-4a06-a96e-dafa2d7a58ae", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71562024-11-21T01:23:11.797ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71572024-11-21T01:23:11.798ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5ae0b532-1b88-4ecf-b49c-887b442e0898", "date": "Thu, 21 Nov 2024 01:23:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71582024-11-21T01:23:11.799ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71592024-11-21T01:23:11.800ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
71602024-11-21T01:23:11.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 497.692724ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71612024-11-21T01:23:11.802ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
71622024-11-21T01:23:11.802ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71632024-11-21T01:23:11.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "332bd8a6-e00e-4bfb-a779-5f08acaf0e3f", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
71642024-11-21T01:23:11.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71652024-11-21T01:23:11.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71662024-11-21T01:23:11.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71672024-11-21T01:23:11.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71682024-11-21T01:23:11.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71692024-11-21T01:23:11.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71702024-11-21T01:23:11.811ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
71712024-11-21T01:23:11.811ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
71722024-11-21T01:23:11.811ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71732024-11-21T01:23:11.811ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71742024-11-21T01:23:11.811ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2b8cccbd-9e8e-4421-bda3-90bb3f672b3e", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
71752024-11-21T01:23:11.814ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 510.90472ms iteration = 13 status = {}
71762024-11-21T01:23:11.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71772024-11-21T01:23:11.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71782024-11-21T01:23:11.830ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
71792024-11-21T01:23:11.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71802024-11-21T01:23:11.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71812024-11-21T01:23:11.837ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71822024-11-21T01:23:11.837ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "15b43b74-bede-4405-832b-f2c519650e8f", "content-length": "134", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
71832024-11-21T01:23:11.837ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71842024-11-21T01:23:11.837ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
71852024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71862024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71872024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71882024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71892024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71902024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71912024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71922024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71932024-11-21T01:23:11.838ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
71942024-11-21T01:23:11.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71952024-11-21T01:23:11.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71962024-11-21T01:23:11.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71972024-11-21T01:23:11.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0fabb13-41d9-4e7b-a354-a96a75ced5cc", "content-length": "2", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
71982024-11-21T01:23:11.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71992024-11-21T01:23:11.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ca26b71-d7d7-4fc5-834b-fb8aca3b8e4c", "content-length": "51", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
72002024-11-21T01:23:11.840ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
72012024-11-21T01:23:11.840ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72022024-11-21T01:23:11.845ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
72032024-11-21T01:23:11.845ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:35049
72042024-11-21T01:23:11.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:35049 req_id = 65eef58a-9524-4d3e-a7dc-57b935c4a580 roles = RoleSet { roles: {} } uri = /metrics/producers
72052024-11-21T01:23:11.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:35049 req_id = 65eef58a-9524-4d3e-a7dc-57b935c4a580 resource = Database result = Ok(()) uri = /metrics/producers
72062024-11-21T01:23:11.887ZINFOnexus: assigned collector to new producer collector_id = 49435a09-4a28-49d2-bf6d-81a21cb92fe2 file = nexus/src/app/oximeter.rs:76 producer_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
72072024-11-21T01:23:11.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42273 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:35049 req_id = 65eef58a-9524-4d3e-a7dc-57b935c4a580 response_code = 201 uri = /metrics/producers
72082024-11-21T01:23:11.887ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "65eef58a-9524-4d3e-a7dc-57b935c4a580", "content-length": "41", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
72092024-11-21T01:23:11.889ZDEBGnexus (producer-registration-task): registered with nexus successfully
72102024-11-21T01:23:11.889ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
72112024-11-21T01:23:11.938ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3b186b15-d56b-4281-8e0c-c0c74ac6ac68", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
72122024-11-21T01:23:11.938ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
72132024-11-21T01:23:11.938ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72142024-11-21T01:23:11.939ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ea9a9d7-b478-49f3-ad88-13335c28d42e", "content-length": "682", "date": "Thu, 21 Nov 2024 01:23:11 GMT"} })
72152024-11-21T01:23:11.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72162024-11-21T01:23:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72172024-11-21T01:23:12.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72182024-11-21T01:23:12.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72192024-11-21T01:23:12.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72202024-11-21T01:23:12.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72212024-11-21T01:23:12.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72222024-11-21T01:23:12.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72232024-11-21T01:23:12.050ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 747.869829ms iteration = 13 status = {}
72242024-11-21T01:23:12.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b8ea3bd5-8d36-488b-af4f-1c858e27c678 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72252024-11-21T01:23:12.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b8ea3bd5-8d36-488b-af4f-1c858e27c678 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72262024-11-21T01:23:12.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b8ea3bd5-8d36-488b-af4f-1c858e27c678 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72272024-11-21T01:23:13.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93dc5ad6-c67a-4665-955c-fde92dd7cf00 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72282024-11-21T01:23:13.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93dc5ad6-c67a-4665-955c-fde92dd7cf00 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72292024-11-21T01:23:13.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93dc5ad6-c67a-4665-955c-fde92dd7cf00 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72302024-11-21T01:23:14.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42743c89-3c26-454a-9ab3-f14f4c198b6c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72312024-11-21T01:23:14.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42743c89-3c26-454a-9ab3-f14f4c198b6c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72322024-11-21T01:23:14.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42743c89-3c26-454a-9ab3-f14f4c198b6c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72332024-11-21T01:23:15.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0158aacb-e621-4361-b3ec-eee2d5523e46 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72342024-11-21T01:23:15.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0158aacb-e621-4361-b3ec-eee2d5523e46 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72352024-11-21T01:23:15.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0158aacb-e621-4361-b3ec-eee2d5523e46 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72362024-11-21T01:23:16.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87bf8590-8e54-432f-8376-81493dd44ab5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72372024-11-21T01:23:16.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87bf8590-8e54-432f-8376-81493dd44ab5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72382024-11-21T01:23:16.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 87bf8590-8e54-432f-8376-81493dd44ab5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72392024-11-21T01:23:17.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01e5664b-7226-4d31-8ec4-f7bbf4615e6b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72402024-11-21T01:23:17.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01e5664b-7226-4d31-8ec4-f7bbf4615e6b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72412024-11-21T01:23:17.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 01e5664b-7226-4d31-8ec4-f7bbf4615e6b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72422024-11-21T01:23:18.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 664 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 02f68d40-ac43-4020-9643-a7d6982b31b6 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
72432024-11-21T01:23:18.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 44f77219-51d8-46c4-8dc6-2f714c7b3f8a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72442024-11-21T01:23:18.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 44f77219-51d8-46c4-8dc6-2f714c7b3f8a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72452024-11-21T01:23:18.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 44f77219-51d8-46c4-8dc6-2f714c7b3f8a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72462024-11-21T01:23:19.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3355605c-45c5-479b-b78b-a6842694a24b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72472024-11-21T01:23:19.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3355605c-45c5-479b-b78b-a6842694a24b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72482024-11-21T01:23:19.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3355605c-45c5-479b-b78b-a6842694a24b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72492024-11-21T01:23:20.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a612cb49-11ab-4b5b-bdd3-e48fab6557d9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72502024-11-21T01:23:20.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a612cb49-11ab-4b5b-bdd3-e48fab6557d9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72512024-11-21T01:23:20.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a612cb49-11ab-4b5b-bdd3-e48fab6557d9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72522024-11-21T01:23:21.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
72532024-11-21T01:23:21.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72542024-11-21T01:23:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72552024-11-21T01:23:21.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
72562024-11-21T01:23:21.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72572024-11-21T01:23:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72582024-11-21T01:23:21.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72592024-11-21T01:23:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72602024-11-21T01:23:21.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72612024-11-21T01:23:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72622024-11-21T01:23:21.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72632024-11-21T01:23:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72642024-11-21T01:23:21.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72652024-11-21T01:23:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
72662024-11-21T01:23:21.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72672024-11-21T01:23:21.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72682024-11-21T01:23:21.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
72692024-11-21T01:23:21.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.381296ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
72702024-11-21T01:23:21.332ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72712024-11-21T01:23:21.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72722024-11-21T01:23:21.333ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.382079ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72732024-11-21T01:23:21.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7ac71e0-c1f1-4333-9a39-9a131730fbc8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72742024-11-21T01:23:21.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7ac71e0-c1f1-4333-9a39-9a131730fbc8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72752024-11-21T01:23:21.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b7ac71e0-c1f1-4333-9a39-9a131730fbc8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72762024-11-21T01:23:23.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 55a9e495-7e36-43f6-b231-88b53eb26933 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72772024-11-21T01:23:23.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 55a9e495-7e36-43f6-b231-88b53eb26933 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72782024-11-21T01:23:23.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 55a9e495-7e36-43f6-b231-88b53eb26933 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72792024-11-21T01:23:23.480ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:49606
72802024-11-21T01:23:23.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = c862a9bb-faf8-4ef3-89b5-642c97be4d66 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
72812024-11-21T01:23:23.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = c862a9bb-faf8-4ef3-89b5-642c97be4d66 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
72822024-11-21T01:23:23.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = c862a9bb-faf8-4ef3-89b5-642c97be4d66 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
72832024-11-21T01:23:23.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = f89e5e69-5d5d-49dc-aadd-41b017cee23c roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
72842024-11-21T01:23:23.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = f89e5e69-5d5d-49dc-aadd-41b017cee23c resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
72852024-11-21T01:23:23.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = f89e5e69-5d5d-49dc-aadd-41b017cee23c response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
72862024-11-21T01:23:24.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9255da77-fdc9-4ddf-b33a-47cc4d8c449d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72872024-11-21T01:23:24.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9255da77-fdc9-4ddf-b33a-47cc4d8c449d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72882024-11-21T01:23:24.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9255da77-fdc9-4ddf-b33a-47cc4d8c449d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72892024-11-21T01:23:25.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 54911401-2942-42e8-ac89-79a06563de9b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72902024-11-21T01:23:25.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 54911401-2942-42e8-ac89-79a06563de9b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72912024-11-21T01:23:25.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 54911401-2942-42e8-ac89-79a06563de9b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72922024-11-21T01:23:26.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f8de1ffd-0c41-42e5-8d40-4c14fa2add08 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72932024-11-21T01:23:26.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f8de1ffd-0c41-42e5-8d40-4c14fa2add08 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72942024-11-21T01:23:26.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f8de1ffd-0c41-42e5-8d40-4c14fa2add08 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72952024-11-21T01:23:27.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07655c72-3981-4ed5-85cb-3db689782443 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72962024-11-21T01:23:27.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07655c72-3981-4ed5-85cb-3db689782443 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72972024-11-21T01:23:27.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 07655c72-3981-4ed5-85cb-3db689782443 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72982024-11-21T01:23:28.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4cbd7318-4fcc-4983-a3f6-9a07c80ddc6d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
72992024-11-21T01:23:28.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4cbd7318-4fcc-4983-a3f6-9a07c80ddc6d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73002024-11-21T01:23:28.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4cbd7318-4fcc-4983-a3f6-9a07c80ddc6d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73012024-11-21T01:23:29.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dd454b14-59dd-45ed-8d6c-74ad98b19086 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73022024-11-21T01:23:29.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dd454b14-59dd-45ed-8d6c-74ad98b19086 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73032024-11-21T01:23:29.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dd454b14-59dd-45ed-8d6c-74ad98b19086 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73042024-11-21T01:23:30.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6f7b1636-a1b2-4dc8-b453-e858290bce18 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73052024-11-21T01:23:30.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6f7b1636-a1b2-4dc8-b453-e858290bce18 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73062024-11-21T01:23:30.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6f7b1636-a1b2-4dc8-b453-e858290bce18 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73072024-11-21T01:23:31.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45cfff27-a6e5-45d7-9ebc-aadb9748eb26 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73082024-11-21T01:23:31.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45cfff27-a6e5-45d7-9ebc-aadb9748eb26 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73092024-11-21T01:23:31.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 45cfff27-a6e5-45d7-9ebc-aadb9748eb26 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73102024-11-21T01:23:31.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
73112024-11-21T01:23:31.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73122024-11-21T01:23:31.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73132024-11-21T01:23:31.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
73142024-11-21T01:23:31.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73152024-11-21T01:23:31.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73162024-11-21T01:23:31.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73172024-11-21T01:23:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73182024-11-21T01:23:31.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73192024-11-21T01:23:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73202024-11-21T01:23:31.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73212024-11-21T01:23:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73222024-11-21T01:23:31.335ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73232024-11-21T01:23:31.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73242024-11-21T01:23:31.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73252024-11-21T01:23:31.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
73262024-11-21T01:23:31.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73272024-11-21T01:23:31.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73282024-11-21T01:23:31.359ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
73292024-11-21T01:23:31.359ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.296023ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
73302024-11-21T01:23:31.369ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.375706ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73312024-11-21T01:23:32.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5392bbe9-b848-41d0-adb8-81990e94b958 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73322024-11-21T01:23:32.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5392bbe9-b848-41d0-adb8-81990e94b958 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73332024-11-21T01:23:32.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5392bbe9-b848-41d0-adb8-81990e94b958 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73342024-11-21T01:23:33.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3bcd2b08-5b90-4fa3-a0ff-8eaab61c23d1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73352024-11-21T01:23:33.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3bcd2b08-5b90-4fa3-a0ff-8eaab61c23d1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73362024-11-21T01:23:33.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3bcd2b08-5b90-4fa3-a0ff-8eaab61c23d1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73372024-11-21T01:23:33.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 856 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 10a9fea8-b07f-4e26-a26a-f66d889b787f response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
73382024-11-21T01:23:34.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b80c1ef-3d06-4b73-a5f7-defded01efb5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73392024-11-21T01:23:34.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b80c1ef-3d06-4b73-a5f7-defded01efb5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73402024-11-21T01:23:34.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b80c1ef-3d06-4b73-a5f7-defded01efb5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73412024-11-21T01:23:35.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0eb1c099-5575-4b4e-831f-618debcb6fb9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73422024-11-21T01:23:35.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0eb1c099-5575-4b4e-831f-618debcb6fb9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73432024-11-21T01:23:35.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0eb1c099-5575-4b4e-831f-618debcb6fb9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73442024-11-21T01:23:36.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf1a45c2-ed39-49dc-a7f6-2594eb1f4b59 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73452024-11-21T01:23:36.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf1a45c2-ed39-49dc-a7f6-2594eb1f4b59 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73462024-11-21T01:23:36.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf1a45c2-ed39-49dc-a7f6-2594eb1f4b59 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73472024-11-21T01:23:37.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c2ad3956-3ac8-44d5-8b49-eb613158debf roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73482024-11-21T01:23:37.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c2ad3956-3ac8-44d5-8b49-eb613158debf resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73492024-11-21T01:23:37.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c2ad3956-3ac8-44d5-8b49-eb613158debf response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73502024-11-21T01:23:38.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ec7b277d-8f56-44b1-81db-3bf6c3d9688c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73512024-11-21T01:23:38.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ec7b277d-8f56-44b1-81db-3bf6c3d9688c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73522024-11-21T01:23:38.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ec7b277d-8f56-44b1-81db-3bf6c3d9688c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73532024-11-21T01:23:39.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8ee2f558-3fd7-44ee-98dd-bacd965338bc roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73542024-11-21T01:23:39.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8ee2f558-3fd7-44ee-98dd-bacd965338bc resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73552024-11-21T01:23:39.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8ee2f558-3fd7-44ee-98dd-bacd965338bc response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73562024-11-21T01:23:40.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf8ad798-023d-4120-af4e-f8f72041e72b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73572024-11-21T01:23:40.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf8ad798-023d-4120-af4e-f8f72041e72b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73582024-11-21T01:23:40.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf8ad798-023d-4120-af4e-f8f72041e72b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
73592024-11-21T01:23:40.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = b36b5e1c-5f73-4268-9a03-2775ce5d417a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
73602024-11-21T01:23:40.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = b36b5e1c-5f73-4268-9a03-2775ce5d417a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
73612024-11-21T01:23:40.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = b36b5e1c-5f73-4268-9a03-2775ce5d417a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
73622024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
73632024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
73642024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
73652024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73662024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73672024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
73682024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73692024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
73702024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73712024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
73722024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
73732024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73742024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73752024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
73762024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
73772024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73782024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73792024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73802024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73812024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73822024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73832024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73842024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73852024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73862024-11-21T01:23:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73872024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
73882024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73892024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
73902024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73912024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73922024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
73932024-11-21T01:23:41.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73942024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73952024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
73962024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73972024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73982024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73992024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74002024-11-21T01:23:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74012024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
74022024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
74032024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74042024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74052024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
74062024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74072024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
74082024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74092024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74102024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74112024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74122024-11-21T01:23:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74132024-11-21T01:23:41.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74142024-11-21T01:23:41.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74152024-11-21T01:23:41.306ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.612441ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74162024-11-21T01:23:41.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74172024-11-21T01:23:41.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1400, tv_nsec: 205799281 } })
74182024-11-21T01:23:41.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
74192024-11-21T01:23:41.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74202024-11-21T01:23:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74212024-11-21T01:23:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74222024-11-21T01:23:41.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74232024-11-21T01:23:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74242024-11-21T01:23:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74252024-11-21T01:23:41.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74262024-11-21T01:23:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74272024-11-21T01:23:41.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74282024-11-21T01:23:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74292024-11-21T01:23:41.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74302024-11-21T01:23:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74312024-11-21T01:23:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74322024-11-21T01:23:41.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74332024-11-21T01:23:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74342024-11-21T01:23:41.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74352024-11-21T01:23:41.312ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1400, tv_nsec: 210106472 } })
74362024-11-21T01:23:41.312ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
74372024-11-21T01:23:41.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74382024-11-21T01:23:41.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74392024-11-21T01:23:41.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74402024-11-21T01:23:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74412024-11-21T01:23:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74422024-11-21T01:23:41.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74432024-11-21T01:23:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74442024-11-21T01:23:41.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.287603ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
74452024-11-21T01:23:41.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74462024-11-21T01:23:41.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74472024-11-21T01:23:41.319ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1400, tv_nsec: 217519596 } })
74482024-11-21T01:23:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74492024-11-21T01:23:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74502024-11-21T01:23:41.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74512024-11-21T01:23:41.319ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
74522024-11-21T01:23:41.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74532024-11-21T01:23:41.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74542024-11-21T01:23:41.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74552024-11-21T01:23:41.354ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74562024-11-21T01:23:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74572024-11-21T01:23:41.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74582024-11-21T01:23:41.355ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74592024-11-21T01:23:41.355ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
74602024-11-21T01:23:41.355ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74612024-11-21T01:23:41.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74622024-11-21T01:23:41.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74632024-11-21T01:23:41.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74642024-11-21T01:23:41.356ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74652024-11-21T01:23:41.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74662024-11-21T01:23:41.357ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74672024-11-21T01:23:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74682024-11-21T01:23:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74692024-11-21T01:23:41.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74702024-11-21T01:23:41.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74712024-11-21T01:23:41.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.534439ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
74722024-11-21T01:23:41.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74732024-11-21T01:23:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74742024-11-21T01:23:41.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.468154ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74752024-11-21T01:23:41.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74762024-11-21T01:23:41.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74772024-11-21T01:23:41.367ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74782024-11-21T01:23:41.367ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.365023ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74792024-11-21T01:23:41.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
74802024-11-21T01:23:41.368ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74812024-11-21T01:23:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74822024-11-21T01:23:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74832024-11-21T01:23:41.369ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74842024-11-21T01:23:41.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74852024-11-21T01:23:41.371ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
74862024-11-21T01:23:41.371ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74872024-11-21T01:23:41.372ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41539b1a-9834-4810-841f-0d35829843b3", "content-length": "26", "date": "Thu, 21 Nov 2024 01:23:40 GMT"} })
74882024-11-21T01:23:41.372ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74892024-11-21T01:23:41.373ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74902024-11-21T01:23:41.387ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
74912024-11-21T01:23:41.387ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.170867ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
74922024-11-21T01:23:41.390ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.838654ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74932024-11-21T01:23:41.392ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
74942024-11-21T01:23:41.392ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74952024-11-21T01:23:41.392ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59b865cc-a115-4bc4-a6ae-bca90137bc0a", "content-length": "26", "date": "Thu, 21 Nov 2024 01:23:40 GMT"} })
74962024-11-21T01:23:41.392ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74972024-11-21T01:23:41.394ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74982024-11-21T01:23:41.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74992024-11-21T01:23:41.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.535931ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
75002024-11-21T01:23:41.397ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75012024-11-21T01:23:41.397ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75022024-11-21T01:23:41.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75032024-11-21T01:23:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
75042024-11-21T01:23:41.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75052024-11-21T01:23:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75062024-11-21T01:23:41.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.459992ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
75072024-11-21T01:23:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75082024-11-21T01:23:41.399ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 96.759833ms iteration = 14 status = 0
75092024-11-21T01:23:41.401ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
75102024-11-21T01:23:41.401ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75112024-11-21T01:23:41.401ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec02f1d8-83b6-425e-83d1-9f8fd91f3807", "content-length": "26", "date": "Thu, 21 Nov 2024 01:23:40 GMT"} })
75122024-11-21T01:23:41.401ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75132024-11-21T01:23:41.404ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
75142024-11-21T01:23:41.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75152024-11-21T01:23:41.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75162024-11-21T01:23:41.439ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75172024-11-21T01:23:41.439ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75182024-11-21T01:23:41.439ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.933361ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75192024-11-21T01:23:41.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2a144f3f-7201-4119-bf47-6ebfeb7ff74d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
75202024-11-21T01:23:41.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2a144f3f-7201-4119-bf47-6ebfeb7ff74d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
75212024-11-21T01:23:41.482ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.369228ms iteration = 16 status = {"physical_disks_added":0}
75222024-11-21T01:23:41.549ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75232024-11-21T01:23:41.549ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75242024-11-21T01:23:41.550ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9346e80b-6c99-42d5-be2a-f3d3544190ef", "content-length": "372", "date": "Thu, 21 Nov 2024 01:23:40 GMT"} })
75252024-11-21T01:23:41.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75262024-11-21T01:23:41.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75272024-11-21T01:23:41.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2a144f3f-7201-4119-bf47-6ebfeb7ff74d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
75282024-11-21T01:23:41.577ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 273.979601ms iteration = 14 status = {}
75292024-11-21T01:23:41.579ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75302024-11-21T01:23:41.579ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b8be23-62e6-425b-93c6-fa527e83c610", "content-length": "1", "date": "Thu, 21 Nov 2024 01:23:41 GMT"} })
75312024-11-21T01:23:41.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75322024-11-21T01:23:41.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75332024-11-21T01:23:41.583ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 280.124668ms iteration = 14 status = null
75342024-11-21T01:23:41.605ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
75352024-11-21T01:23:41.605ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75362024-11-21T01:23:41.605ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "44f7de70-a370-45eb-a516-927dcfd617df", "date": "Thu, 21 Nov 2024 01:23:40 GMT"} })
75372024-11-21T01:23:41.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75382024-11-21T01:23:41.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75392024-11-21T01:23:41.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75402024-11-21T01:23:41.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75412024-11-21T01:23:41.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75422024-11-21T01:23:41.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75432024-11-21T01:23:41.615ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
75442024-11-21T01:23:41.615ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75452024-11-21T01:23:41.615ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cd40ce07-f67e-4591-bc2b-2dd51acebce9", "date": "Thu, 21 Nov 2024 01:23:40 GMT"} })
75462024-11-21T01:23:41.617ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 313.589739ms iteration = 14 status = {}
75472024-11-21T01:23:41.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75482024-11-21T01:23:41.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75492024-11-21T01:23:41.623ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
75502024-11-21T01:23:41.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75512024-11-21T01:23:41.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75522024-11-21T01:23:41.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75532024-11-21T01:23:41.634ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "32afb1a1-ca29-4df3-9d27-c8feecadef19", "content-length": "134", "date": "Thu, 21 Nov 2024 01:23:41 GMT"} })
75542024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75552024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
75562024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75572024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75582024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75592024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75602024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75612024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75622024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75632024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75642024-11-21T01:23:41.634ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
75652024-11-21T01:23:41.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75662024-11-21T01:23:41.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75672024-11-21T01:23:41.636ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75682024-11-21T01:23:41.637ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d43fdb7-2ce6-4da0-a2de-d840c58e21f7", "content-length": "2", "date": "Thu, 21 Nov 2024 01:23:41 GMT"} })
75692024-11-21T01:23:41.637ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75702024-11-21T01:23:41.637ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d3347b2-f5e0-47ff-a19d-14e14bb4ab1a", "content-length": "51", "date": "Thu, 21 Nov 2024 01:23:41 GMT"} })
75712024-11-21T01:23:41.637ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
75722024-11-21T01:23:41.637ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75732024-11-21T01:23:41.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75742024-11-21T01:23:41.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75752024-11-21T01:23:41.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75762024-11-21T01:23:41.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75772024-11-21T01:23:41.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75782024-11-21T01:23:41.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75792024-11-21T01:23:41.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75802024-11-21T01:23:41.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75812024-11-21T01:23:41.648ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75822024-11-21T01:23:41.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75832024-11-21T01:23:41.681ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75842024-11-21T01:23:41.737ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5c6833b6-7642-4163-8008-11c44f2c43a9", "date": "Thu, 21 Nov 2024 01:23:40 GMT"} })
75852024-11-21T01:23:41.737ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
75862024-11-21T01:23:41.737ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75872024-11-21T01:23:41.738ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "81d6d2bd-99d2-443f-aad4-ff7890c8f4e1", "content-length": "691", "date": "Thu, 21 Nov 2024 01:23:40 GMT"} })
75882024-11-21T01:23:41.738ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
75892024-11-21T01:23:41.738ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
75902024-11-21T01:23:41.738ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
75912024-11-21T01:23:41.738ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b5f8028-9109-4905-b7ab-2160bbd0655a", "content-length": "682", "date": "Thu, 21 Nov 2024 01:23:41 GMT"} })
75922024-11-21T01:23:41.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75932024-11-21T01:23:41.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75942024-11-21T01:23:41.739ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 436.625643ms iteration = 14 status = {}
75952024-11-21T01:23:41.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75962024-11-21T01:23:41.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75972024-11-21T01:23:41.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75982024-11-21T01:23:41.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75992024-11-21T01:23:41.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76002024-11-21T01:23:41.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76012024-11-21T01:23:41.755ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 452.470986ms iteration = 14 status = {}
76022024-11-21T01:23:42.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 90b40427-0ea2-4795-9f76-82d3b44468a6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76032024-11-21T01:23:42.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 90b40427-0ea2-4795-9f76-82d3b44468a6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76042024-11-21T01:23:42.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 90b40427-0ea2-4795-9f76-82d3b44468a6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76052024-11-21T01:23:43.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f4234ea6-afe5-46ec-a150-32f2ee3fd4ff roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76062024-11-21T01:23:43.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f4234ea6-afe5-46ec-a150-32f2ee3fd4ff resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76072024-11-21T01:23:43.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f4234ea6-afe5-46ec-a150-32f2ee3fd4ff response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76082024-11-21T01:23:44.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0ed1ede1-b25d-495c-aba0-b6aae9b67539 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76092024-11-21T01:23:44.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0ed1ede1-b25d-495c-aba0-b6aae9b67539 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76102024-11-21T01:23:44.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0ed1ede1-b25d-495c-aba0-b6aae9b67539 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76112024-11-21T01:23:45.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a4cae4a0-e41d-4846-a48e-a33377ae883a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76122024-11-21T01:23:45.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a4cae4a0-e41d-4846-a48e-a33377ae883a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76132024-11-21T01:23:45.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a4cae4a0-e41d-4846-a48e-a33377ae883a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76142024-11-21T01:23:46.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 876dacec-fe76-4139-9294-9853a881737d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76152024-11-21T01:23:46.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 876dacec-fe76-4139-9294-9853a881737d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76162024-11-21T01:23:46.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 876dacec-fe76-4139-9294-9853a881737d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76172024-11-21T01:23:47.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3793d9bd-6093-472a-bc5c-d2830a8f35cc roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76182024-11-21T01:23:47.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3793d9bd-6093-472a-bc5c-d2830a8f35cc resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76192024-11-21T01:23:47.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3793d9bd-6093-472a-bc5c-d2830a8f35cc response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76202024-11-21T01:23:48.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 626 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 767c5009-bbb1-4b5b-84e3-947d41e8568b response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
76212024-11-21T01:23:48.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05bf7e6a-c0f5-4a9f-a3b4-77188d959b20 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76222024-11-21T01:23:48.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05bf7e6a-c0f5-4a9f-a3b4-77188d959b20 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76232024-11-21T01:23:48.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05bf7e6a-c0f5-4a9f-a3b4-77188d959b20 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76242024-11-21T01:23:49.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0bfde850-6ebb-4934-ac26-0b5a1606751c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76252024-11-21T01:23:49.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0bfde850-6ebb-4934-ac26-0b5a1606751c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76262024-11-21T01:23:49.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0bfde850-6ebb-4934-ac26-0b5a1606751c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76272024-11-21T01:23:50.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b9ee5564-3eda-4071-af2c-6e4ce30f3dd6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76282024-11-21T01:23:50.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b9ee5564-3eda-4071-af2c-6e4ce30f3dd6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76292024-11-21T01:23:50.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b9ee5564-3eda-4071-af2c-6e4ce30f3dd6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76302024-11-21T01:23:51.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
76312024-11-21T01:23:51.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76322024-11-21T01:23:51.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76332024-11-21T01:23:51.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
76342024-11-21T01:23:51.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76352024-11-21T01:23:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76362024-11-21T01:23:51.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76372024-11-21T01:23:51.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76382024-11-21T01:23:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76392024-11-21T01:23:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76402024-11-21T01:23:51.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76412024-11-21T01:23:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76422024-11-21T01:23:51.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.56043ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76432024-11-21T01:23:51.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76442024-11-21T01:23:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76452024-11-21T01:23:51.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76462024-11-21T01:23:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
76472024-11-21T01:23:51.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76482024-11-21T01:23:51.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76492024-11-21T01:23:51.328ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
76502024-11-21T01:23:51.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.438979ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
76512024-11-21T01:23:51.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19acf3b2-27fb-48a6-a97d-c293319f1157 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76522024-11-21T01:23:51.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19acf3b2-27fb-48a6-a97d-c293319f1157 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76532024-11-21T01:23:51.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19acf3b2-27fb-48a6-a97d-c293319f1157 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76542024-11-21T01:23:52.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce05b82c-edd3-47c4-9d2b-f67ba725ef05 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76552024-11-21T01:23:52.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce05b82c-edd3-47c4-9d2b-f67ba725ef05 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76562024-11-21T01:23:52.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ce05b82c-edd3-47c4-9d2b-f67ba725ef05 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76572024-11-21T01:23:53.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7186c0bb-80fb-4fc8-a30a-f7a5e994c5a1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76582024-11-21T01:23:53.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7186c0bb-80fb-4fc8-a30a-f7a5e994c5a1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76592024-11-21T01:23:53.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7186c0bb-80fb-4fc8-a30a-f7a5e994c5a1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76602024-11-21T01:23:54.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = caa6a870-b78c-4922-931a-b1bd4e378c03 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76612024-11-21T01:23:54.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = caa6a870-b78c-4922-931a-b1bd4e378c03 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76622024-11-21T01:23:54.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = caa6a870-b78c-4922-931a-b1bd4e378c03 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76632024-11-21T01:23:55.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6761b74a-2c9c-4f20-9fb8-89ed5f09d457 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76642024-11-21T01:23:55.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6761b74a-2c9c-4f20-9fb8-89ed5f09d457 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76652024-11-21T01:23:55.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6761b74a-2c9c-4f20-9fb8-89ed5f09d457 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76662024-11-21T01:23:56.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cf73efc-f9c1-4308-b640-778bb53ba815 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76672024-11-21T01:23:56.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cf73efc-f9c1-4308-b640-778bb53ba815 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76682024-11-21T01:23:56.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cf73efc-f9c1-4308-b640-778bb53ba815 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76692024-11-21T01:23:57.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ec160ea-1251-4dd4-aa69-6105a741816e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76702024-11-21T01:23:57.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ec160ea-1251-4dd4-aa69-6105a741816e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76712024-11-21T01:23:57.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ec160ea-1251-4dd4-aa69-6105a741816e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76722024-11-21T01:23:58.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a7290a0-4dc0-4af0-8d72-b07ced96b67f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76732024-11-21T01:23:58.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a7290a0-4dc0-4af0-8d72-b07ced96b67f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76742024-11-21T01:23:58.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a7290a0-4dc0-4af0-8d72-b07ced96b67f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76752024-11-21T01:23:59.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 261576bd-35e8-4f87-8c2c-0afa25bc2389 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76762024-11-21T01:23:59.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 261576bd-35e8-4f87-8c2c-0afa25bc2389 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76772024-11-21T01:23:59.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 261576bd-35e8-4f87-8c2c-0afa25bc2389 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76782024-11-21T01:24:00.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d42ac9d-d110-45fd-bc71-c77e489c702d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76792024-11-21T01:24:00.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d42ac9d-d110-45fd-bc71-c77e489c702d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76802024-11-21T01:24:00.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d42ac9d-d110-45fd-bc71-c77e489c702d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
76812024-11-21T01:24:01.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
76822024-11-21T01:24:01.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76832024-11-21T01:24:01.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76842024-11-21T01:24:01.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
76852024-11-21T01:24:01.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76862024-11-21T01:24:01.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76872024-11-21T01:24:01.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76882024-11-21T01:24:01.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76892024-11-21T01:24:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76902024-11-21T01:24:01.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.716993ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76912024-11-21T01:24:01.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76922024-11-21T01:24:01.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76932024-11-21T01:24:01.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76942024-11-21T01:24:01.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76952024-11-21T01:24:01.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76962024-11-21T01:24:01.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972024-11-21T01:24:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
76982024-11-21T01:24:01.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76992024-11-21T01:24:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77002024-11-21T01:24:01.326ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
77012024-11-21T01:24:01.326ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.130015ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
77022024-11-21T01:24:01.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4dfa739f-fdaf-4336-8a99-1c61cdb980ab roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77032024-11-21T01:24:02.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4dfa739f-fdaf-4336-8a99-1c61cdb980ab resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77042024-11-21T01:24:02.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4dfa739f-fdaf-4336-8a99-1c61cdb980ab response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77052024-11-21T01:24:03.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1956f419-1832-44e0-b02b-dfbc7e8c0de6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77062024-11-21T01:24:03.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1956f419-1832-44e0-b02b-dfbc7e8c0de6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77072024-11-21T01:24:03.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1956f419-1832-44e0-b02b-dfbc7e8c0de6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77082024-11-21T01:24:03.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 885 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = f48d47e1-89b1-4650-a268-5e7e673d6f70 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
77092024-11-21T01:24:04.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8aac6497-2bba-4ffc-ba73-27b3a1959e6f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77102024-11-21T01:24:04.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8aac6497-2bba-4ffc-ba73-27b3a1959e6f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77112024-11-21T01:24:04.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8aac6497-2bba-4ffc-ba73-27b3a1959e6f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77122024-11-21T01:24:05.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2cc6307b-c942-40d3-bdb8-6d905fda4764 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77132024-11-21T01:24:05.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2cc6307b-c942-40d3-bdb8-6d905fda4764 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77142024-11-21T01:24:05.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2cc6307b-c942-40d3-bdb8-6d905fda4764 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77152024-11-21T01:24:06.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c4c2aff7-4b02-4227-993e-4bc4b1b14569 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77162024-11-21T01:24:06.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c4c2aff7-4b02-4227-993e-4bc4b1b14569 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77172024-11-21T01:24:06.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c4c2aff7-4b02-4227-993e-4bc4b1b14569 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77182024-11-21T01:24:07.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a387bc9d-a8b5-42e7-b626-8c8d5c31c71d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77192024-11-21T01:24:07.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a387bc9d-a8b5-42e7-b626-8c8d5c31c71d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77202024-11-21T01:24:07.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a387bc9d-a8b5-42e7-b626-8c8d5c31c71d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77212024-11-21T01:24:08.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cc9d881f-ec95-4c8c-b816-49894b04507a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77222024-11-21T01:24:08.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cc9d881f-ec95-4c8c-b816-49894b04507a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77232024-11-21T01:24:08.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cc9d881f-ec95-4c8c-b816-49894b04507a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77242024-11-21T01:24:08.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 5f08fc8d-32a7-40b5-bd73-84491561b1d9 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
77252024-11-21T01:24:08.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 5f08fc8d-32a7-40b5-bd73-84491561b1d9 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
77262024-11-21T01:24:08.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 5f08fc8d-32a7-40b5-bd73-84491561b1d9 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
77272024-11-21T01:24:08.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 20c4473b-dc75-413a-ae26-9208a05c0408 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
77282024-11-21T01:24:08.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 20c4473b-dc75-413a-ae26-9208a05c0408 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
77292024-11-21T01:24:08.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 20c4473b-dc75-413a-ae26-9208a05c0408 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
77302024-11-21T01:24:09.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9b2f4719-496f-46f3-9739-5634170fc7f6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77312024-11-21T01:24:09.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9b2f4719-496f-46f3-9739-5634170fc7f6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77322024-11-21T01:24:09.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9b2f4719-496f-46f3-9739-5634170fc7f6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77332024-11-21T01:24:10.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd8ebd85-7a06-499b-bb26-8c5da5d3768d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77342024-11-21T01:24:10.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd8ebd85-7a06-499b-bb26-8c5da5d3768d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77352024-11-21T01:24:10.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd8ebd85-7a06-499b-bb26-8c5da5d3768d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77362024-11-21T01:24:11.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = ee544fa8-f495-45d8-9faa-d46984e521a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
77372024-11-21T01:24:11.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = ee544fa8-f495-45d8-9faa-d46984e521a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
77382024-11-21T01:24:11.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = ee544fa8-f495-45d8-9faa-d46984e521a1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
77392024-11-21T01:24:11.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 73c0f4aa-0ad5-45e0-b3a2-a9b14b281fe0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77402024-11-21T01:24:11.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 73c0f4aa-0ad5-45e0-b3a2-a9b14b281fe0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77412024-11-21T01:24:11.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 73c0f4aa-0ad5-45e0-b3a2-a9b14b281fe0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
77422024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
77432024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
77442024-11-21T01:24:11.302ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
77452024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77462024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
77472024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.88\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
77482024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
77492024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77502024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77512024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
77522024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
77532024-11-21T01:24:11.302ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:14:11.302893130 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
77542024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
77552024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
77562024-11-21T01:24:11.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
77572024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
77582024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77592024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77602024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
77612024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77622024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
77632024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
77642024-11-21T01:24:11.303ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
77652024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77662024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
77672024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77682024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
77692024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77702024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
77712024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
77722024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
77732024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77742024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
77752024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
77762024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
77772024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77782024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
77792024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77802024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77812024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77822024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77832024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
77842024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77852024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77862024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77872024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77882024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77892024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77902024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77912024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77922024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77932024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
77942024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77952024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
77962024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77972024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
77982024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77992024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78002024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
78012024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78022024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
78032024-11-21T01:24:11.303ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78042024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78052024-11-21T01:24:11.303ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 201513511 } })
78062024-11-21T01:24:11.303ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 201524271 } })
78072024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78082024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
78092024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78102024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78112024-11-21T01:24:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78122024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
78132024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.161607ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
78142024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
78152024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.353649ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
78162024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
78172024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
78182024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
78192024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78202024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
78212024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78222024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
78232024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78242024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
78252024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
78262024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
78272024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78282024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78292024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
78302024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78312024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
78322024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78332024-11-21T01:24:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78342024-11-21T01:24:11.305ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 203701732 } })
78352024-11-21T01:24:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.910531ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78362024-11-21T01:24:11.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78372024-11-21T01:24:11.306ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
78382024-11-21T01:24:11.307ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:14:11.302893130 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
78392024-11-21T01:24:11.307ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.603225ms iteration = 8 status = {"expiration":"2024-11-21T01:14:11.302893130Z","pruned":[]}
78402024-11-21T01:24:11.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 205318534 } })
78412024-11-21T01:24:11.307ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
78422024-11-21T01:24:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78432024-11-21T01:24:11.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78442024-11-21T01:24:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78452024-11-21T01:24:11.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78462024-11-21T01:24:11.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78472024-11-21T01:24:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78482024-11-21T01:24:11.309ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78492024-11-21T01:24:11.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78502024-11-21T01:24:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78512024-11-21T01:24:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78522024-11-21T01:24:11.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78532024-11-21T01:24:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78542024-11-21T01:24:11.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78552024-11-21T01:24:11.312ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78562024-11-21T01:24:11.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78572024-11-21T01:24:11.312ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78582024-11-21T01:24:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78592024-11-21T01:24:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78602024-11-21T01:24:11.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78612024-11-21T01:24:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78622024-11-21T01:24:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78632024-11-21T01:24:11.314ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78642024-11-21T01:24:11.314ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78652024-11-21T01:24:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78662024-11-21T01:24:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
78672024-11-21T01:24:11.315ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
78682024-11-21T01:24:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
78692024-11-21T01:24:11.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78702024-11-21T01:24:11.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78712024-11-21T01:24:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78722024-11-21T01:24:11.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78732024-11-21T01:24:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78742024-11-21T01:24:11.319ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78752024-11-21T01:24:11.319ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78762024-11-21T01:24:11.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78772024-11-21T01:24:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78782024-11-21T01:24:11.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78792024-11-21T01:24:11.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78802024-11-21T01:24:11.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78812024-11-21T01:24:11.321ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78822024-11-21T01:24:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78832024-11-21T01:24:11.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78842024-11-21T01:24:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78852024-11-21T01:24:11.322ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.968063ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
78862024-11-21T01:24:11.325ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1430, tv_nsec: 222850441 } })
78872024-11-21T01:24:11.325ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
78882024-11-21T01:24:11.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78892024-11-21T01:24:11.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78902024-11-21T01:24:11.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78912024-11-21T01:24:11.327ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78922024-11-21T01:24:11.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78932024-11-21T01:24:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78942024-11-21T01:24:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78952024-11-21T01:24:11.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78962024-11-21T01:24:11.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78972024-11-21T01:24:11.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78982024-11-21T01:24:11.329ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
78992024-11-21T01:24:11.330ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
79002024-11-21T01:24:11.330ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
79012024-11-21T01:24:11.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79022024-11-21T01:24:11.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79032024-11-21T01:24:11.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79042024-11-21T01:24:11.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79052024-11-21T01:24:11.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79062024-11-21T01:24:11.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79072024-11-21T01:24:11.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79082024-11-21T01:24:11.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
79092024-11-21T01:24:11.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79102024-11-21T01:24:11.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79112024-11-21T01:24:11.337ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79122024-11-21T01:24:11.338ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79132024-11-21T01:24:11.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
79142024-11-21T01:24:11.341ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79152024-11-21T01:24:11.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79162024-11-21T01:24:11.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79172024-11-21T01:24:11.341ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79182024-11-21T01:24:11.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79192024-11-21T01:24:11.367ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79202024-11-21T01:24:11.367ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
79212024-11-21T01:24:11.367ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.505429ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
79222024-11-21T01:24:11.367ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79232024-11-21T01:24:11.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79242024-11-21T01:24:11.369ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79252024-11-21T01:24:11.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79262024-11-21T01:24:11.369ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79272024-11-21T01:24:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79282024-11-21T01:24:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79292024-11-21T01:24:11.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.507031ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
79302024-11-21T01:24:11.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.622027ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
79312024-11-21T01:24:11.374ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.388662ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
79322024-11-21T01:24:11.377ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79332024-11-21T01:24:11.377ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
79342024-11-21T01:24:11.377ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
79352024-11-21T01:24:11.377ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.887507ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
79362024-11-21T01:24:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79372024-11-21T01:24:11.380ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79382024-11-21T01:24:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79392024-11-21T01:24:11.381ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
79402024-11-21T01:24:11.381ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
79412024-11-21T01:24:11.381ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.911972ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
79422024-11-21T01:24:11.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79432024-11-21T01:24:11.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79442024-11-21T01:24:11.388ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79452024-11-21T01:24:11.388ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
79462024-11-21T01:24:11.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79472024-11-21T01:24:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79482024-11-21T01:24:11.388ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79492024-11-21T01:24:11.388ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.909567ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79502024-11-21T01:24:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79512024-11-21T01:24:11.389ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79522024-11-21T01:24:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79532024-11-21T01:24:11.389ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.383617ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79542024-11-21T01:24:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
79552024-11-21T01:24:11.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79562024-11-21T01:24:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79572024-11-21T01:24:11.392ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.280008ms iteration = 15 status = 0
79582024-11-21T01:24:11.413ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79592024-11-21T01:24:11.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79602024-11-21T01:24:11.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79612024-11-21T01:24:11.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79622024-11-21T01:24:11.415ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79632024-11-21T01:24:11.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79642024-11-21T01:24:11.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79652024-11-21T01:24:11.417ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.264936ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
79662024-11-21T01:24:11.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.355616ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
79672024-11-21T01:24:11.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
79682024-11-21T01:24:11.419ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79692024-11-21T01:24:11.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79702024-11-21T01:24:11.423ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
79712024-11-21T01:24:11.423ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
79722024-11-21T01:24:11.423ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
79732024-11-21T01:24:11.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79742024-11-21T01:24:11.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79752024-11-21T01:24:11.431ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
79762024-11-21T01:24:11.431ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
79772024-11-21T01:24:11.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79782024-11-21T01:24:11.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79792024-11-21T01:24:11.439ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79802024-11-21T01:24:11.439ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
79812024-11-21T01:24:11.439ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.28484ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
79822024-11-21T01:24:11.445ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79832024-11-21T01:24:11.454ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
79842024-11-21T01:24:11.454ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79852024-11-21T01:24:11.454ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27113b3c-753f-4bef-9aaf-5a409a2045d9", "content-length": "26", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
79862024-11-21T01:24:11.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79872024-11-21T01:24:11.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79882024-11-21T01:24:11.468ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
79892024-11-21T01:24:11.468ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 165.129637ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79902024-11-21T01:24:11.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79912024-11-21T01:24:11.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79922024-11-21T01:24:11.486ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79932024-11-21T01:24:11.495ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.246659ms iteration = 17 status = {"physical_disks_added":0}
79942024-11-21T01:24:11.512ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
79952024-11-21T01:24:11.512ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 209.35817ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
79962024-11-21T01:24:11.575ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
79972024-11-21T01:24:11.575ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79982024-11-21T01:24:11.576ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a72f70b6-b4b9-49df-81f2-d5fdd4d63d65", "content-length": "26", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
79992024-11-21T01:24:11.576ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80002024-11-21T01:24:11.577ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80012024-11-21T01:24:11.604ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
80022024-11-21T01:24:11.604ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80032024-11-21T01:24:11.604ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afef9401-d68f-41d7-aeb4-2d2bca585f28", "content-length": "26", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
80042024-11-21T01:24:11.604ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80052024-11-21T01:24:11.605ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
80062024-11-21T01:24:11.629ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.559111ms iteration = 15 status = {}
80072024-11-21T01:24:11.629ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
80082024-11-21T01:24:11.717ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80092024-11-21T01:24:11.717ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80102024-11-21T01:24:11.717ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ba70919-c2f6-4964-956d-8a530b5e85fe", "content-length": "372", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
80112024-11-21T01:24:11.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80122024-11-21T01:24:11.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80132024-11-21T01:24:11.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80142024-11-21T01:24:11.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80152024-11-21T01:24:11.720ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80162024-11-21T01:24:11.720ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f30064b-37f3-4b6a-9796-8e96514561a2", "content-length": "1", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
80172024-11-21T01:24:11.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80182024-11-21T01:24:11.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80192024-11-21T01:24:11.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80202024-11-21T01:24:11.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80212024-11-21T01:24:11.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80222024-11-21T01:24:11.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80232024-11-21T01:24:11.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80242024-11-21T01:24:11.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80252024-11-21T01:24:11.725ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 422.389332ms iteration = 15 status = null
80262024-11-21T01:24:11.725ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
80272024-11-21T01:24:11.725ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
80282024-11-21T01:24:11.725ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
80292024-11-21T01:24:11.725ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 422.782428ms iteration = 8 status = {"generation":2}
80302024-11-21T01:24:11.738ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80312024-11-21T01:24:11.738ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80322024-11-21T01:24:11.738ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c3f815a5-8781-4d48-86be-c42d9db8646a", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
80332024-11-21T01:24:11.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80342024-11-21T01:24:11.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80352024-11-21T01:24:11.739ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
80362024-11-21T01:24:11.739ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c1fd2a7b-2521-4f5e-a1bb-5af17d85b5bb", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80372024-11-21T01:24:11.739ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80382024-11-21T01:24:11.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80392024-11-21T01:24:11.741ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "892c1bae-f8ef-472e-b946-74834e42c5c8", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80402024-11-21T01:24:11.741ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80412024-11-21T01:24:11.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80422024-11-21T01:24:11.742ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
80432024-11-21T01:24:11.742ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 440.040741ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
80442024-11-21T01:24:11.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80452024-11-21T01:24:11.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80462024-11-21T01:24:11.745ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80472024-11-21T01:24:11.746ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8e38c0ba-0582-417f-b7ea-7807d4dd138d", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80482024-11-21T01:24:11.746ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80492024-11-21T01:24:11.747ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d3e8f02f-4235-4e4c-8648-02f99c754f48", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80502024-11-21T01:24:11.747ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80512024-11-21T01:24:11.749ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "313e3711-603b-4e8a-8d28-63389d4c54d0", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80522024-11-21T01:24:11.749ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80532024-11-21T01:24:11.751ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
80542024-11-21T01:24:11.751ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 448.46357ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80552024-11-21T01:24:11.754ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80562024-11-21T01:24:11.754ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80572024-11-21T01:24:11.755ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2060a6ae-0aaf-4ea3-b74c-bf9ba96e74b8", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
80582024-11-21T01:24:11.757ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 453.602642ms iteration = 15 status = {}
80592024-11-21T01:24:11.761ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80602024-11-21T01:24:11.761ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
80612024-11-21T01:24:11.761ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
80622024-11-21T01:24:11.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80632024-11-21T01:24:11.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80642024-11-21T01:24:11.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80652024-11-21T01:24:11.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80662024-11-21T01:24:11.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80672024-11-21T01:24:11.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80682024-11-21T01:24:11.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80692024-11-21T01:24:11.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80702024-11-21T01:24:11.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80712024-11-21T01:24:11.770ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80722024-11-21T01:24:11.770ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80732024-11-21T01:24:11.770ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
80742024-11-21T01:24:11.770ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 467.126013ms iteration = 8 status = {"generation":1}
80752024-11-21T01:24:11.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80762024-11-21T01:24:11.793ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80772024-11-21T01:24:11.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80782024-11-21T01:24:11.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80792024-11-21T01:24:11.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80802024-11-21T01:24:11.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80812024-11-21T01:24:11.809ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
80822024-11-21T01:24:11.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80832024-11-21T01:24:11.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80842024-11-21T01:24:11.831ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80852024-11-21T01:24:11.831ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d419847-332f-4982-b594-53644f44af18", "content-length": "691", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
80862024-11-21T01:24:11.832ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
80872024-11-21T01:24:11.832ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
80882024-11-21T01:24:11.832ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
80892024-11-21T01:24:11.832ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 529.691945ms iteration = 15 status = {}
80902024-11-21T01:24:11.841ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80912024-11-21T01:24:11.841ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "975e1f47-ef8b-440b-ad78-a9915f5585eb", "content-length": "134", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
80922024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80932024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
80942024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80952024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80962024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80972024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80982024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80992024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81002024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81012024-11-21T01:24:11.841ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81022024-11-21T01:24:11.842ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
81032024-11-21T01:24:11.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81042024-11-21T01:24:11.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81052024-11-21T01:24:11.844ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81062024-11-21T01:24:11.844ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "31b9fd56-fb59-4698-8a00-03beaae2f720", "content-length": "2", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
81072024-11-21T01:24:11.844ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81082024-11-21T01:24:11.844ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c2cedbe-1a92-4ed3-9148-8d59bbc1b5f9", "content-length": "51", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
81092024-11-21T01:24:11.844ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
81102024-11-21T01:24:11.844ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81112024-11-21T01:24:11.946ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "759bf82a-23a5-47b1-a52f-4f609d432636", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
81122024-11-21T01:24:11.946ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
81132024-11-21T01:24:11.946ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81142024-11-21T01:24:11.946ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "be813143-053d-455c-b9c3-43b1ba6924f6", "content-length": "682", "date": "Thu, 21 Nov 2024 01:24:11 GMT"} })
81152024-11-21T01:24:11.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81162024-11-21T01:24:11.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81172024-11-21T01:24:11.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81182024-11-21T01:24:11.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81192024-11-21T01:24:11.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81202024-11-21T01:24:11.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81212024-11-21T01:24:11.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81222024-11-21T01:24:11.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81232024-11-21T01:24:11.962ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 659.729487ms iteration = 15 status = {}
81242024-11-21T01:24:12.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7a070e8c-4e72-4962-8394-dd9d44c15912 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81252024-11-21T01:24:12.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7a070e8c-4e72-4962-8394-dd9d44c15912 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81262024-11-21T01:24:12.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7a070e8c-4e72-4962-8394-dd9d44c15912 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81272024-11-21T01:24:13.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bcaec3a-1315-4d87-894f-6a0901d45ee4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81282024-11-21T01:24:13.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bcaec3a-1315-4d87-894f-6a0901d45ee4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81292024-11-21T01:24:13.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bcaec3a-1315-4d87-894f-6a0901d45ee4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81302024-11-21T01:24:14.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 80982535-63cc-4f9b-950f-ef4bf7242c22 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81312024-11-21T01:24:14.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 80982535-63cc-4f9b-950f-ef4bf7242c22 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81322024-11-21T01:24:14.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 80982535-63cc-4f9b-950f-ef4bf7242c22 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81332024-11-21T01:24:15.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0faadf4c-85e6-4eda-a85a-fe2245c505fc roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81342024-11-21T01:24:15.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0faadf4c-85e6-4eda-a85a-fe2245c505fc resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81352024-11-21T01:24:15.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0faadf4c-85e6-4eda-a85a-fe2245c505fc response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81362024-11-21T01:24:16.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bf95a6e7-5491-4f98-bb2c-cb1da7d1c138 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81372024-11-21T01:24:16.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bf95a6e7-5491-4f98-bb2c-cb1da7d1c138 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81382024-11-21T01:24:16.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bf95a6e7-5491-4f98-bb2c-cb1da7d1c138 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81392024-11-21T01:24:17.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e0c0da0a-11bc-413e-a433-fe1afe4828c9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81402024-11-21T01:24:17.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e0c0da0a-11bc-413e-a433-fe1afe4828c9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81412024-11-21T01:24:17.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e0c0da0a-11bc-413e-a433-fe1afe4828c9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81422024-11-21T01:24:18.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d094766e-4614-4463-bf4d-51279b0e4a01 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81432024-11-21T01:24:18.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d094766e-4614-4463-bf4d-51279b0e4a01 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81442024-11-21T01:24:18.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d094766e-4614-4463-bf4d-51279b0e4a01 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81452024-11-21T01:24:18.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 691 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 24f61c3e-36b1-4178-a488-20227ea595f8 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
81462024-11-21T01:24:19.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0da5266f-20d9-4d08-87f1-5b4684bfddcb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81472024-11-21T01:24:19.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0da5266f-20d9-4d08-87f1-5b4684bfddcb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81482024-11-21T01:24:19.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0da5266f-20d9-4d08-87f1-5b4684bfddcb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81492024-11-21T01:24:20.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e8f93b5-c5f1-4185-9d61-7d38683636f5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81502024-11-21T01:24:20.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e8f93b5-c5f1-4185-9d61-7d38683636f5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81512024-11-21T01:24:20.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8e8f93b5-c5f1-4185-9d61-7d38683636f5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81522024-11-21T01:24:21.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
81532024-11-21T01:24:21.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81542024-11-21T01:24:21.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81552024-11-21T01:24:21.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
81562024-11-21T01:24:21.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81572024-11-21T01:24:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81582024-11-21T01:24:21.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81592024-11-21T01:24:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81602024-11-21T01:24:21.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81612024-11-21T01:24:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81622024-11-21T01:24:21.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81632024-11-21T01:24:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81642024-11-21T01:24:21.332ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81652024-11-21T01:24:21.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81662024-11-21T01:24:21.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81672024-11-21T01:24:21.341ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
81682024-11-21T01:24:21.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81692024-11-21T01:24:21.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81702024-11-21T01:24:21.355ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
81712024-11-21T01:24:21.355ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.46639ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
81722024-11-21T01:24:21.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.698559ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81732024-11-21T01:24:21.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ceb7c98-7664-4c80-94c4-9ea289477c69 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81742024-11-21T01:24:21.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ceb7c98-7664-4c80-94c4-9ea289477c69 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81752024-11-21T01:24:21.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ceb7c98-7664-4c80-94c4-9ea289477c69 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81762024-11-21T01:24:22.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51b43551-371b-426f-b278-a073e237b7a3 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81772024-11-21T01:24:22.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51b43551-371b-426f-b278-a073e237b7a3 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81782024-11-21T01:24:22.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 51b43551-371b-426f-b278-a073e237b7a3 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81792024-11-21T01:24:23.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aca5fbb0-f92b-4fc7-bb5d-cb8c5a6de020 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81802024-11-21T01:24:23.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aca5fbb0-f92b-4fc7-bb5d-cb8c5a6de020 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81812024-11-21T01:24:23.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 76f7baca-9b32-4dbc-872b-4f30a61bb8b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
81822024-11-21T01:24:23.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 76f7baca-9b32-4dbc-872b-4f30a61bb8b4 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
81832024-11-21T01:24:23.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aca5fbb0-f92b-4fc7-bb5d-cb8c5a6de020 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81842024-11-21T01:24:23.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 76f7baca-9b32-4dbc-872b-4f30a61bb8b4 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
81852024-11-21T01:24:23.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 51a12191-85ad-4eb8-a927-7877c60593f0 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
81862024-11-21T01:24:23.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 51a12191-85ad-4eb8-a927-7877c60593f0 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
81872024-11-21T01:24:23.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 51a12191-85ad-4eb8-a927-7877c60593f0 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
81882024-11-21T01:24:24.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86ce85dd-8601-49da-be4b-1d573d64ae8a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81892024-11-21T01:24:24.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86ce85dd-8601-49da-be4b-1d573d64ae8a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81902024-11-21T01:24:24.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86ce85dd-8601-49da-be4b-1d573d64ae8a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81912024-11-21T01:24:25.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c7e66f92-1a42-42f9-b462-c064498c1da4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81922024-11-21T01:24:25.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c7e66f92-1a42-42f9-b462-c064498c1da4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81932024-11-21T01:24:25.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c7e66f92-1a42-42f9-b462-c064498c1da4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81942024-11-21T01:24:26.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b2191775-f972-473b-933b-29958d3051d5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81952024-11-21T01:24:26.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b2191775-f972-473b-933b-29958d3051d5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81962024-11-21T01:24:26.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b2191775-f972-473b-933b-29958d3051d5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81972024-11-21T01:24:27.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7790da22-d5b3-487a-995c-b773a92e16f2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81982024-11-21T01:24:27.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7790da22-d5b3-487a-995c-b773a92e16f2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
81992024-11-21T01:24:27.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7790da22-d5b3-487a-995c-b773a92e16f2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82002024-11-21T01:24:28.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e0721b9-d70e-4336-ba44-34805b99bc56 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82012024-11-21T01:24:28.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e0721b9-d70e-4336-ba44-34805b99bc56 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82022024-11-21T01:24:28.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e0721b9-d70e-4336-ba44-34805b99bc56 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82032024-11-21T01:24:29.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 931c5936-0ba4-4bec-bb9a-8b3a8611686b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82042024-11-21T01:24:29.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 931c5936-0ba4-4bec-bb9a-8b3a8611686b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82052024-11-21T01:24:29.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 931c5936-0ba4-4bec-bb9a-8b3a8611686b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82062024-11-21T01:24:30.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aed276a7-de2a-4d50-a987-cc4ff189aea5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82072024-11-21T01:24:30.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aed276a7-de2a-4d50-a987-cc4ff189aea5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82082024-11-21T01:24:30.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aed276a7-de2a-4d50-a987-cc4ff189aea5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82092024-11-21T01:24:31.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
82102024-11-21T01:24:31.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82112024-11-21T01:24:31.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82122024-11-21T01:24:31.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
82132024-11-21T01:24:31.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82142024-11-21T01:24:31.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82152024-11-21T01:24:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82162024-11-21T01:24:31.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82172024-11-21T01:24:31.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82182024-11-21T01:24:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82192024-11-21T01:24:31.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82202024-11-21T01:24:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82212024-11-21T01:24:31.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82222024-11-21T01:24:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82232024-11-21T01:24:31.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82242024-11-21T01:24:31.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
82252024-11-21T01:24:31.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82262024-11-21T01:24:31.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82272024-11-21T01:24:31.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
82282024-11-21T01:24:31.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.191422ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
82292024-11-21T01:24:31.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.55478ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82302024-11-21T01:24:31.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 77b39926-84e3-413c-b9ef-7dbacfb7b439 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82312024-11-21T01:24:31.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 77b39926-84e3-413c-b9ef-7dbacfb7b439 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82322024-11-21T01:24:31.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 77b39926-84e3-413c-b9ef-7dbacfb7b439 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82332024-11-21T01:24:32.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9a4703a3-0225-42a7-a69e-3370f8bcd8b5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82342024-11-21T01:24:32.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9a4703a3-0225-42a7-a69e-3370f8bcd8b5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82352024-11-21T01:24:32.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9a4703a3-0225-42a7-a69e-3370f8bcd8b5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82362024-11-21T01:24:33.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 694 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = de314039-411c-4b27-acbd-8998dc20ba60 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
82372024-11-21T01:24:33.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2bdb2471-4bf2-4bb3-be3a-92ae7f583be0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82382024-11-21T01:24:33.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2bdb2471-4bf2-4bb3-be3a-92ae7f583be0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82392024-11-21T01:24:33.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2bdb2471-4bf2-4bb3-be3a-92ae7f583be0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82402024-11-21T01:24:34.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cdc771b-14ac-4f26-882e-043eebc04081 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82412024-11-21T01:24:34.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cdc771b-14ac-4f26-882e-043eebc04081 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82422024-11-21T01:24:34.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cdc771b-14ac-4f26-882e-043eebc04081 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82432024-11-21T01:24:35.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d3221a3-3cf5-46aa-8aab-7daed43717de roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82442024-11-21T01:24:35.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d3221a3-3cf5-46aa-8aab-7daed43717de resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82452024-11-21T01:24:35.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d3221a3-3cf5-46aa-8aab-7daed43717de response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82462024-11-21T01:24:36.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d30ce11-1ab2-4d94-8997-1042fb084e8c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82472024-11-21T01:24:36.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d30ce11-1ab2-4d94-8997-1042fb084e8c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82482024-11-21T01:24:36.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d30ce11-1ab2-4d94-8997-1042fb084e8c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82492024-11-21T01:24:37.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93e3fe97-9576-46bf-8570-eca8c4c27b2a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82502024-11-21T01:24:37.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93e3fe97-9576-46bf-8570-eca8c4c27b2a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82512024-11-21T01:24:37.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 93e3fe97-9576-46bf-8570-eca8c4c27b2a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82522024-11-21T01:24:38.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 92f4ab37-8ccf-4f00-879c-f42044539a90 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82532024-11-21T01:24:38.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 92f4ab37-8ccf-4f00-879c-f42044539a90 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82542024-11-21T01:24:38.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 92f4ab37-8ccf-4f00-879c-f42044539a90 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82552024-11-21T01:24:39.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbc36f9e-12b5-4f6a-bd99-41f9e97d114b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82562024-11-21T01:24:39.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbc36f9e-12b5-4f6a-bd99-41f9e97d114b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82572024-11-21T01:24:39.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbc36f9e-12b5-4f6a-bd99-41f9e97d114b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82582024-11-21T01:24:40.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cf06e8f-844d-4dce-bfa7-327414e695bc roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82592024-11-21T01:24:40.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cf06e8f-844d-4dce-bfa7-327414e695bc resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82602024-11-21T01:24:40.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cf06e8f-844d-4dce-bfa7-327414e695bc response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
82612024-11-21T01:24:41.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 856bcba6-e4b9-4be3-9e2d-acd15572391f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
82622024-11-21T01:24:41.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 856bcba6-e4b9-4be3-9e2d-acd15572391f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
82632024-11-21T01:24:41.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3879 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 856bcba6-e4b9-4be3-9e2d-acd15572391f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
82642024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
82652024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82662024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
82672024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82682024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
82692024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
82702024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82712024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
82722024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82732024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82742024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
82752024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82762024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
82772024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
82782024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82792024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82802024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
82812024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82822024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82832024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82842024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82852024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82862024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82872024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82882024-11-21T01:24:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82892024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
82902024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
82912024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82922024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82932024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
82942024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82952024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82962024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
82972024-11-21T01:24:41.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82982024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82992024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
83002024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83012024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
83022024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83032024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
83042024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83052024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
83062024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83072024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83082024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83092024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83102024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83112024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83122024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83132024-11-21T01:24:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
83142024-11-21T01:24:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83152024-11-21T01:24:41.306ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.768789ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83162024-11-21T01:24:41.306ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1460, tv_nsec: 204121177 } })
83172024-11-21T01:24:41.306ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1460, tv_nsec: 204201419 } })
83182024-11-21T01:24:41.306ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
83192024-11-21T01:24:41.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83202024-11-21T01:24:41.307ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
83212024-11-21T01:24:41.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83222024-11-21T01:24:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83232024-11-21T01:24:41.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83242024-11-21T01:24:41.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83252024-11-21T01:24:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83262024-11-21T01:24:41.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83272024-11-21T01:24:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83282024-11-21T01:24:41.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83292024-11-21T01:24:41.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83302024-11-21T01:24:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83312024-11-21T01:24:41.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83322024-11-21T01:24:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83332024-11-21T01:24:41.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83342024-11-21T01:24:41.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83352024-11-21T01:24:41.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83362024-11-21T01:24:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83372024-11-21T01:24:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83382024-11-21T01:24:41.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83392024-11-21T01:24:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83402024-11-21T01:24:41.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83412024-11-21T01:24:41.319ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1460, tv_nsec: 217198192 } })
83422024-11-21T01:24:41.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83432024-11-21T01:24:41.319ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
83442024-11-21T01:24:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83452024-11-21T01:24:41.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83462024-11-21T01:24:41.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83472024-11-21T01:24:41.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83482024-11-21T01:24:41.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83492024-11-21T01:24:41.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83502024-11-21T01:24:41.356ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.562977ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
83512024-11-21T01:24:41.359ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83522024-11-21T01:24:41.359ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83532024-11-21T01:24:41.359ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.163827ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
83542024-11-21T01:24:41.360ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83552024-11-21T01:24:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83562024-11-21T01:24:41.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83572024-11-21T01:24:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83582024-11-21T01:24:41.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83592024-11-21T01:24:41.360ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83602024-11-21T01:24:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83612024-11-21T01:24:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83622024-11-21T01:24:41.362ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83632024-11-21T01:24:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83642024-11-21T01:24:41.362ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83652024-11-21T01:24:41.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
83662024-11-21T01:24:41.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83672024-11-21T01:24:41.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83682024-11-21T01:24:41.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83692024-11-21T01:24:41.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83702024-11-21T01:24:41.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83712024-11-21T01:24:41.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.442197ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83722024-11-21T01:24:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83732024-11-21T01:24:41.364ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83742024-11-21T01:24:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83752024-11-21T01:24:41.366ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83762024-11-21T01:24:41.366ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83772024-11-21T01:24:41.366ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83782024-11-21T01:24:41.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83792024-11-21T01:24:41.414ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
83802024-11-21T01:24:41.414ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83812024-11-21T01:24:41.414ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6aed30e-cc73-40aa-a366-0e752abacfca", "content-length": "26", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
83822024-11-21T01:24:41.414ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83832024-11-21T01:24:41.416ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83842024-11-21T01:24:41.417ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
83852024-11-21T01:24:41.417ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83862024-11-21T01:24:41.417ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2470367-5e33-4657-8d38-06e0acde4da3", "content-length": "26", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
83872024-11-21T01:24:41.417ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83882024-11-21T01:24:41.419ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83892024-11-21T01:24:41.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83902024-11-21T01:24:41.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83912024-11-21T01:24:41.448ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83922024-11-21T01:24:41.448ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83932024-11-21T01:24:41.448ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ced5be7-7988-43bb-bf7b-791f4ad85f55", "content-length": "372", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
83942024-11-21T01:24:41.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83952024-11-21T01:24:41.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83962024-11-21T01:24:41.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83972024-11-21T01:24:41.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83982024-11-21T01:24:41.470ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
83992024-11-21T01:24:41.470ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 167.527971ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
84002024-11-21T01:24:41.473ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
84012024-11-21T01:24:41.473ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84022024-11-21T01:24:41.474ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f41cfdc2-b395-4a5b-8f7b-f07977b42479", "content-length": "26", "date": "Thu, 21 Nov 2024 01:24:41 GMT"} })
84032024-11-21T01:24:41.474ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84042024-11-21T01:24:41.477ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
84052024-11-21T01:24:41.485ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84062024-11-21T01:24:41.485ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84072024-11-21T01:24:41.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84082024-11-21T01:24:41.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84092024-11-21T01:24:41.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84102024-11-21T01:24:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84112024-11-21T01:24:41.489ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84122024-11-21T01:24:41.489ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84132024-11-21T01:24:41.489ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84142024-11-21T01:24:41.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84152024-11-21T01:24:41.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84162024-11-21T01:24:41.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 187.827967ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84172024-11-21T01:24:41.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84182024-11-21T01:24:41.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84192024-11-21T01:24:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84202024-11-21T01:24:41.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 191.953275ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84212024-11-21T01:24:41.501ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84222024-11-21T01:24:41.501ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 196.60497ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84232024-11-21T01:24:41.512ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
84242024-11-21T01:24:41.512ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84252024-11-21T01:24:41.513ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "38c4b6de-6440-4940-aeef-683c294288e4", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
84262024-11-21T01:24:41.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84272024-11-21T01:24:41.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84282024-11-21T01:24:41.515ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.723403ms iteration = 16 status = {}
84292024-11-21T01:24:41.516ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84302024-11-21T01:24:41.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84312024-11-21T01:24:41.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84322024-11-21T01:24:41.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84332024-11-21T01:24:41.523ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84342024-11-21T01:24:41.523ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84352024-11-21T01:24:41.523ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 219.19678ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84362024-11-21T01:24:41.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84372024-11-21T01:24:41.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 221.768486ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
84382024-11-21T01:24:41.526ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84392024-11-21T01:24:41.526ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84402024-11-21T01:24:41.526ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a8d2f1c6-5fb2-4d92-afc2-306401950371", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
84412024-11-21T01:24:41.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
84422024-11-21T01:24:41.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84432024-11-21T01:24:41.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84442024-11-21T01:24:41.528ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 224.170889ms iteration = 16 status = {}
84452024-11-21T01:24:41.529ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 225.692871ms iteration = 16 status = 0
84462024-11-21T01:24:41.529ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84472024-11-21T01:24:41.529ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "be5ce14b-a38a-4fc4-bf0c-510c2c15c45c", "content-length": "1", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
84482024-11-21T01:24:41.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84492024-11-21T01:24:41.531ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84502024-11-21T01:24:41.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84512024-11-21T01:24:41.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84522024-11-21T01:24:41.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84532024-11-21T01:24:41.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84542024-11-21T01:24:41.532ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 229.624396ms iteration = 16 status = null
84552024-11-21T01:24:41.562ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 259.099592ms iteration = 18 status = {"physical_disks_added":0}
84562024-11-21T01:24:41.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84572024-11-21T01:24:41.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84582024-11-21T01:24:41.614ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
84592024-11-21T01:24:41.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84602024-11-21T01:24:41.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84612024-11-21T01:24:41.623ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84622024-11-21T01:24:41.624ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ac58743-a4ff-43cc-9a38-c75b675ee67c", "content-length": "134", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
84632024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84642024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
84652024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84662024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84672024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84682024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84692024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84702024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84712024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84722024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84732024-11-21T01:24:41.624ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
84742024-11-21T01:24:41.625ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84752024-11-21T01:24:41.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84762024-11-21T01:24:41.628ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84772024-11-21T01:24:41.628ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "af1cb180-6f01-4f3f-a262-b8e464a1c968", "content-length": "2", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
84782024-11-21T01:24:41.628ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84792024-11-21T01:24:41.628ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a74df8a-6282-4b19-bdaf-c0fcddc8a75f", "content-length": "51", "date": "Thu, 21 Nov 2024 01:24:40 GMT"} })
84802024-11-21T01:24:41.628ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
84812024-11-21T01:24:41.628ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84822024-11-21T01:24:41.634ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84832024-11-21T01:24:41.724ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "47728576-dc93-453b-a7ef-59c4881e1d74", "date": "Thu, 21 Nov 2024 01:24:41 GMT"} })
84842024-11-21T01:24:41.724ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
84852024-11-21T01:24:41.724ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84862024-11-21T01:24:41.724ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c1fee12-afac-4ec8-89b1-481acb1c00c7", "content-length": "691", "date": "Thu, 21 Nov 2024 01:24:41 GMT"} })
84872024-11-21T01:24:41.724ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
84882024-11-21T01:24:41.724ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
84892024-11-21T01:24:41.724ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
84902024-11-21T01:24:41.724ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb7e923-10d0-48c1-92eb-1e7a15b19d82", "content-length": "682", "date": "Thu, 21 Nov 2024 01:24:41 GMT"} })
84912024-11-21T01:24:41.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84922024-11-21T01:24:41.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84932024-11-21T01:24:41.725ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 422.546564ms iteration = 16 status = {}
84942024-11-21T01:24:41.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84952024-11-21T01:24:41.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84962024-11-21T01:24:41.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84972024-11-21T01:24:41.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84982024-11-21T01:24:41.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84992024-11-21T01:24:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85002024-11-21T01:24:41.742ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 438.778473ms iteration = 16 status = {}
85012024-11-21T01:24:41.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0a55c076-460b-451a-9250-2b197215470a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85022024-11-21T01:24:41.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0a55c076-460b-451a-9250-2b197215470a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85032024-11-21T01:24:41.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0a55c076-460b-451a-9250-2b197215470a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85042024-11-21T01:24:42.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4db1ddfb-5f96-4021-b6ee-4f948834c7ad roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85052024-11-21T01:24:42.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4db1ddfb-5f96-4021-b6ee-4f948834c7ad resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85062024-11-21T01:24:42.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4db1ddfb-5f96-4021-b6ee-4f948834c7ad response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85072024-11-21T01:24:43.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 14a498ea-8f07-49b9-aebb-33f7c80c7048 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85082024-11-21T01:24:43.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 14a498ea-8f07-49b9-aebb-33f7c80c7048 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85092024-11-21T01:24:43.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 14a498ea-8f07-49b9-aebb-33f7c80c7048 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85102024-11-21T01:24:44.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2f47d182-ddcd-4aa6-a45e-97b0eb0a8cd9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85112024-11-21T01:24:44.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2f47d182-ddcd-4aa6-a45e-97b0eb0a8cd9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85122024-11-21T01:24:44.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2f47d182-ddcd-4aa6-a45e-97b0eb0a8cd9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85132024-11-21T01:24:45.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c7b5359d-f884-4bab-a458-08aac914c8a0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85142024-11-21T01:24:45.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c7b5359d-f884-4bab-a458-08aac914c8a0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85152024-11-21T01:24:45.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c7b5359d-f884-4bab-a458-08aac914c8a0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85162024-11-21T01:24:47.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e6319cfb-7b7b-4a0e-8581-4427ed757c19 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85172024-11-21T01:24:47.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e6319cfb-7b7b-4a0e-8581-4427ed757c19 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85182024-11-21T01:24:47.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e6319cfb-7b7b-4a0e-8581-4427ed757c19 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85192024-11-21T01:24:48.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 856cbf30-e0da-49b6-b2ff-f2cbfcdcfdb1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85202024-11-21T01:24:48.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 856cbf30-e0da-49b6-b2ff-f2cbfcdcfdb1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85212024-11-21T01:24:48.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 856cbf30-e0da-49b6-b2ff-f2cbfcdcfdb1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85222024-11-21T01:24:48.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = a6bec3b5-caff-45e2-9e77-d06cdcecf848 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
85232024-11-21T01:24:49.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d074e91-1199-454a-801b-69cc846a3aa6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85242024-11-21T01:24:49.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d074e91-1199-454a-801b-69cc846a3aa6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85252024-11-21T01:24:49.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d074e91-1199-454a-801b-69cc846a3aa6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85262024-11-21T01:24:50.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 26727ec5-8d0f-4fa9-b7bf-67e439f69a64 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85272024-11-21T01:24:50.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 26727ec5-8d0f-4fa9-b7bf-67e439f69a64 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85282024-11-21T01:24:50.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 26727ec5-8d0f-4fa9-b7bf-67e439f69a64 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85292024-11-21T01:24:51.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 59e2e8c1-555a-47e9-8efc-be113bdce5fd roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85302024-11-21T01:24:51.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 59e2e8c1-555a-47e9-8efc-be113bdce5fd resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85312024-11-21T01:24:51.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 59e2e8c1-555a-47e9-8efc-be113bdce5fd response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85322024-11-21T01:24:51.302ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
85332024-11-21T01:24:51.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85342024-11-21T01:24:51.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85352024-11-21T01:24:51.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
85362024-11-21T01:24:51.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85372024-11-21T01:24:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85382024-11-21T01:24:51.335ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85392024-11-21T01:24:51.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85402024-11-21T01:24:51.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85412024-11-21T01:24:51.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85422024-11-21T01:24:51.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85432024-11-21T01:24:51.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85442024-11-21T01:24:51.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85452024-11-21T01:24:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85462024-11-21T01:24:51.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85472024-11-21T01:24:51.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
85482024-11-21T01:24:51.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85492024-11-21T01:24:51.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85502024-11-21T01:24:51.358ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
85512024-11-21T01:24:51.358ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.835807ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
85522024-11-21T01:24:51.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.203799ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85532024-11-21T01:24:52.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b073159-7c54-48e3-9171-99bb2b116de2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85542024-11-21T01:24:52.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b073159-7c54-48e3-9171-99bb2b116de2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85552024-11-21T01:24:52.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4b073159-7c54-48e3-9171-99bb2b116de2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85562024-11-21T01:24:53.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 37debc0c-3d5d-48ae-ae78-a0ad82920c22 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85572024-11-21T01:24:53.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 37debc0c-3d5d-48ae-ae78-a0ad82920c22 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85582024-11-21T01:24:53.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 37debc0c-3d5d-48ae-ae78-a0ad82920c22 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85592024-11-21T01:24:53.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = b431b99a-db57-46ea-8f71-0820c549c9ac roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
85602024-11-21T01:24:53.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = b431b99a-db57-46ea-8f71-0820c549c9ac resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
85612024-11-21T01:24:53.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = b431b99a-db57-46ea-8f71-0820c549c9ac response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
85622024-11-21T01:24:53.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 4504c19a-c6b7-47e3-afee-e11484a426a2 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
85632024-11-21T01:24:53.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 4504c19a-c6b7-47e3-afee-e11484a426a2 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
85642024-11-21T01:24:53.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 4504c19a-c6b7-47e3-afee-e11484a426a2 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
85652024-11-21T01:24:54.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 79e52ddd-7a83-4624-b79c-528bfd94abaf roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85662024-11-21T01:24:54.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 79e52ddd-7a83-4624-b79c-528bfd94abaf resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85672024-11-21T01:24:54.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 79e52ddd-7a83-4624-b79c-528bfd94abaf response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85682024-11-21T01:24:55.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d0809395-2125-4c4f-b7a7-3befc6e6d3f7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85692024-11-21T01:24:55.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d0809395-2125-4c4f-b7a7-3befc6e6d3f7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85702024-11-21T01:24:55.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d0809395-2125-4c4f-b7a7-3befc6e6d3f7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85712024-11-21T01:24:56.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 713fe9d5-9868-495e-82f7-dd14ccc5dfef roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85722024-11-21T01:24:56.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 713fe9d5-9868-495e-82f7-dd14ccc5dfef resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85732024-11-21T01:24:56.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 713fe9d5-9868-495e-82f7-dd14ccc5dfef response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85742024-11-21T01:24:57.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c3b49f6d-f7aa-4b4a-8f86-612cc4495948 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85752024-11-21T01:24:57.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c3b49f6d-f7aa-4b4a-8f86-612cc4495948 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85762024-11-21T01:24:57.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c3b49f6d-f7aa-4b4a-8f86-612cc4495948 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85772024-11-21T01:24:58.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a79e582-3a4d-4f12-92e6-5ebec237cc99 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85782024-11-21T01:24:58.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a79e582-3a4d-4f12-92e6-5ebec237cc99 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85792024-11-21T01:24:58.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a79e582-3a4d-4f12-92e6-5ebec237cc99 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85802024-11-21T01:24:59.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 214ef66e-1f06-4163-9b6d-3f9cd50302c8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85812024-11-21T01:24:59.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 214ef66e-1f06-4163-9b6d-3f9cd50302c8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85822024-11-21T01:24:59.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 214ef66e-1f06-4163-9b6d-3f9cd50302c8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85832024-11-21T01:25:00.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a0f04317-b3b5-4b50-a03a-6a4331e37b88 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85842024-11-21T01:25:00.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a0f04317-b3b5-4b50-a03a-6a4331e37b88 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85852024-11-21T01:25:00.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a0f04317-b3b5-4b50-a03a-6a4331e37b88 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
85862024-11-21T01:25:01.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
85872024-11-21T01:25:01.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85882024-11-21T01:25:01.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85892024-11-21T01:25:01.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
85902024-11-21T01:25:01.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85912024-11-21T01:25:01.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85922024-11-21T01:25:01.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85932024-11-21T01:25:01.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85942024-11-21T01:25:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85952024-11-21T01:25:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85962024-11-21T01:25:01.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85972024-11-21T01:25:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85982024-11-21T01:25:01.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85992024-11-21T01:25:01.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86002024-11-21T01:25:01.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86012024-11-21T01:25:01.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
86022024-11-21T01:25:01.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86032024-11-21T01:25:01.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86042024-11-21T01:25:01.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d5508079-a2d2-4cdc-acf6-4f5ddc188cec roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86052024-11-21T01:25:01.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d5508079-a2d2-4cdc-acf6-4f5ddc188cec resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86062024-11-21T01:25:01.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d5508079-a2d2-4cdc-acf6-4f5ddc188cec response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86072024-11-21T01:25:01.325ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
86082024-11-21T01:25:01.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.99372ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
86092024-11-21T01:25:01.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.275231ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86102024-11-21T01:25:02.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4a60406e-2b0f-42ac-9d3b-ca2d29077bae roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86112024-11-21T01:25:02.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4a60406e-2b0f-42ac-9d3b-ca2d29077bae resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86122024-11-21T01:25:02.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4a60406e-2b0f-42ac-9d3b-ca2d29077bae response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86132024-11-21T01:25:03.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 972a9da9-8a63-44ee-9468-f6f6fdd0430c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86142024-11-21T01:25:03.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 972a9da9-8a63-44ee-9468-f6f6fdd0430c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86152024-11-21T01:25:03.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 972a9da9-8a63-44ee-9468-f6f6fdd0430c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86162024-11-21T01:25:03.490ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 624b2f97-f0ee-46c9-82af-5e913bd2010e response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
86172024-11-21T01:25:04.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0348c4dc-a713-44f6-8ccc-b1836dc2e7ca roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86182024-11-21T01:25:04.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0348c4dc-a713-44f6-8ccc-b1836dc2e7ca resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86192024-11-21T01:25:04.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0348c4dc-a713-44f6-8ccc-b1836dc2e7ca response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86202024-11-21T01:25:05.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c456329-8c24-42ef-98d2-87a00a2ea214 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86212024-11-21T01:25:05.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c456329-8c24-42ef-98d2-87a00a2ea214 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86222024-11-21T01:25:05.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c456329-8c24-42ef-98d2-87a00a2ea214 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86232024-11-21T01:25:06.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0d1e94ae-5d29-4aea-b75f-995b069826ca roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86242024-11-21T01:25:06.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0d1e94ae-5d29-4aea-b75f-995b069826ca resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86252024-11-21T01:25:06.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0d1e94ae-5d29-4aea-b75f-995b069826ca response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86262024-11-21T01:25:07.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e1dc77e-2fb4-4a2d-93df-0e01010319a9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86272024-11-21T01:25:07.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e1dc77e-2fb4-4a2d-93df-0e01010319a9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86282024-11-21T01:25:07.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e1dc77e-2fb4-4a2d-93df-0e01010319a9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86292024-11-21T01:25:08.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42c13d46-d4b5-4ba4-81c7-0058dbb2b880 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86302024-11-21T01:25:08.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42c13d46-d4b5-4ba4-81c7-0058dbb2b880 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86312024-11-21T01:25:08.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42c13d46-d4b5-4ba4-81c7-0058dbb2b880 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86322024-11-21T01:25:09.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdcd63d0-811e-49db-9b94-b3fac1bb7374 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86332024-11-21T01:25:09.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdcd63d0-811e-49db-9b94-b3fac1bb7374 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86342024-11-21T01:25:09.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdcd63d0-811e-49db-9b94-b3fac1bb7374 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86352024-11-21T01:25:10.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bf09ffc4-31da-4acf-84df-d013cf69221a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86362024-11-21T01:25:10.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bf09ffc4-31da-4acf-84df-d013cf69221a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86372024-11-21T01:25:10.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bf09ffc4-31da-4acf-84df-d013cf69221a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
86382024-11-21T01:25:11.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = a7ea02c5-d4cf-43c5-a6f3-119335ff7f32 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
86392024-11-21T01:25:11.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = a7ea02c5-d4cf-43c5-a6f3-119335ff7f32 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
86402024-11-21T01:25:11.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = a7ea02c5-d4cf-43c5-a6f3-119335ff7f32 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
86412024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
86422024-11-21T01:25:11.303ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
86432024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.76\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
86442024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
86452024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
86462024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
86472024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86482024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86492024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
86502024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86512024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
86522024-11-21T01:25:11.303ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
86532024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
86542024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86552024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
86562024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86572024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
86582024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
86592024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86602024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
86612024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
86622024-11-21T01:25:11.303ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:15:11.303708927 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
86632024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86642024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
86652024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
86662024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
86672024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86682024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
86692024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
86702024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86712024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86722024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
86732024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
86742024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86752024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86762024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
86772024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86782024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
86792024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
86802024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
86812024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86822024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86832024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
86842024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
86852024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86862024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
86872024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86882024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
86892024-11-21T01:25:11.303ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
86902024-11-21T01:25:11.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86912024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86922024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86932024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86942024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86952024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
86962024-11-21T01:25:11.304ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 201667313 } })
86972024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86982024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86992024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87002024-11-21T01:25:11.304ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 201770304 } })
87012024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87022024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87032024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
87042024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87052024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87062024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87072024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87082024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87092024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87102024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87112024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
87122024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 977.134\u{b5}s iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
87132024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
87142024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87152024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
87162024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87172024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
87182024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87192024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
87202024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87212024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
87222024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87232024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
87242024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87252024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
87262024-11-21T01:25:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.274938ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
87272024-11-21T01:25:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87282024-11-21T01:25:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
87292024-11-21T01:25:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87302024-11-21T01:25:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87312024-11-21T01:25:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87322024-11-21T01:25:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87332024-11-21T01:25:11.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87342024-11-21T01:25:11.307ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.266716ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87352024-11-21T01:25:11.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87362024-11-21T01:25:11.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 205229713 } })
87372024-11-21T01:25:11.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87382024-11-21T01:25:11.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
87392024-11-21T01:25:11.308ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:15:11.303708927 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87402024-11-21T01:25:11.308ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.171343ms iteration = 9 status = {"expiration":"2024-11-21T01:15:11.303708927Z","pruned":[]}
87412024-11-21T01:25:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87422024-11-21T01:25:11.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87432024-11-21T01:25:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87442024-11-21T01:25:11.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87452024-11-21T01:25:11.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87462024-11-21T01:25:11.312ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87472024-11-21T01:25:11.313ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 211423890 } })
87482024-11-21T01:25:11.314ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
87492024-11-21T01:25:11.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87502024-11-21T01:25:11.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87512024-11-21T01:25:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87522024-11-21T01:25:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87532024-11-21T01:25:11.315ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87542024-11-21T01:25:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87552024-11-21T01:25:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87562024-11-21T01:25:11.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87572024-11-21T01:25:11.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87582024-11-21T01:25:11.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87592024-11-21T01:25:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87602024-11-21T01:25:11.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87612024-11-21T01:25:11.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87622024-11-21T01:25:11.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87632024-11-21T01:25:11.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87642024-11-21T01:25:11.321ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.07711ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
87652024-11-21T01:25:11.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87662024-11-21T01:25:11.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87672024-11-21T01:25:11.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87682024-11-21T01:25:11.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87692024-11-21T01:25:11.332ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1490, tv_nsec: 229667467 } })
87702024-11-21T01:25:11.332ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
87712024-11-21T01:25:11.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87722024-11-21T01:25:11.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87732024-11-21T01:25:11.356ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87742024-11-21T01:25:11.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87752024-11-21T01:25:11.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87762024-11-21T01:25:11.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
87772024-11-21T01:25:11.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87782024-11-21T01:25:11.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87792024-11-21T01:25:11.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.407837ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
87802024-11-21T01:25:11.364ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87812024-11-21T01:25:11.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87822024-11-21T01:25:11.365ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87832024-11-21T01:25:11.366ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87842024-11-21T01:25:11.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87852024-11-21T01:25:11.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87862024-11-21T01:25:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87872024-11-21T01:25:11.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
87882024-11-21T01:25:11.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87892024-11-21T01:25:11.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87902024-11-21T01:25:11.370ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87912024-11-21T01:25:11.370ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87922024-11-21T01:25:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87932024-11-21T01:25:11.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.814146ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
87942024-11-21T01:25:11.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87952024-11-21T01:25:11.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.925723ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
87962024-11-21T01:25:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87972024-11-21T01:25:11.371ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87982024-11-21T01:25:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87992024-11-21T01:25:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88002024-11-21T01:25:11.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88012024-11-21T01:25:11.372ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88022024-11-21T01:25:11.372ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88032024-11-21T01:25:11.372ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.12803ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88042024-11-21T01:25:11.373ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88052024-11-21T01:25:11.373ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88062024-11-21T01:25:11.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88072024-11-21T01:25:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88082024-11-21T01:25:11.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88092024-11-21T01:25:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88102024-11-21T01:25:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88112024-11-21T01:25:11.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88122024-11-21T01:25:11.378ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
88132024-11-21T01:25:11.378ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.998867ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
88142024-11-21T01:25:11.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.538301ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
88152024-11-21T01:25:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88162024-11-21T01:25:11.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88172024-11-21T01:25:11.387ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.938103ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88182024-11-21T01:25:11.390ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88192024-11-21T01:25:11.390ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.363728ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88202024-11-21T01:25:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88212024-11-21T01:25:11.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88222024-11-21T01:25:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88232024-11-21T01:25:11.391ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88242024-11-21T01:25:11.391ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88252024-11-21T01:25:11.391ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.655675ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88262024-11-21T01:25:11.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88272024-11-21T01:25:11.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88282024-11-21T01:25:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88292024-11-21T01:25:11.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88302024-11-21T01:25:11.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88312024-11-21T01:25:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88322024-11-21T01:25:11.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88332024-11-21T01:25:11.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88342024-11-21T01:25:11.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88352024-11-21T01:25:11.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88362024-11-21T01:25:11.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88372024-11-21T01:25:11.417ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88382024-11-21T01:25:11.417ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88392024-11-21T01:25:11.417ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88402024-11-21T01:25:11.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88412024-11-21T01:25:11.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88422024-11-21T01:25:11.417ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88432024-11-21T01:25:11.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88442024-11-21T01:25:11.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88452024-11-21T01:25:11.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88462024-11-21T01:25:11.419ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
88472024-11-21T01:25:11.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88482024-11-21T01:25:11.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88492024-11-21T01:25:11.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88502024-11-21T01:25:11.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88512024-11-21T01:25:11.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88522024-11-21T01:25:11.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.291607ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
88532024-11-21T01:25:11.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88542024-11-21T01:25:11.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88552024-11-21T01:25:11.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88562024-11-21T01:25:11.428ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88572024-11-21T01:25:11.428ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88582024-11-21T01:25:11.428ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
88592024-11-21T01:25:11.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88602024-11-21T01:25:11.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88612024-11-21T01:25:11.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88622024-11-21T01:25:11.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
88632024-11-21T01:25:11.431ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88642024-11-21T01:25:11.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88652024-11-21T01:25:11.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88662024-11-21T01:25:11.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88672024-11-21T01:25:11.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88682024-11-21T01:25:11.433ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.931421ms iteration = 17 status = 0
88692024-11-21T01:25:11.438ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88702024-11-21T01:25:11.438ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88712024-11-21T01:25:11.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88722024-11-21T01:25:11.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88732024-11-21T01:25:11.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88742024-11-21T01:25:11.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88752024-11-21T01:25:11.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88762024-11-21T01:25:11.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88772024-11-21T01:25:11.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88782024-11-21T01:25:11.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88792024-11-21T01:25:11.486ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
88802024-11-21T01:25:11.486ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
88812024-11-21T01:25:11.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88822024-11-21T01:25:11.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88832024-11-21T01:25:11.489ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
88842024-11-21T01:25:11.489ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88852024-11-21T01:25:11.489ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8eb5bb0-a6ce-4c34-9f4b-4e9c462c8fdb", "content-length": "26", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
88862024-11-21T01:25:11.489ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88872024-11-21T01:25:11.490ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
88882024-11-21T01:25:11.490ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 186.463687ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
88892024-11-21T01:25:11.490ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
88902024-11-21T01:25:11.490ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88912024-11-21T01:25:11.490ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5562240-e20e-4a61-a052-2fcfb5187049", "content-length": "26", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
88922024-11-21T01:25:11.490ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88932024-11-21T01:25:11.491ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88942024-11-21T01:25:11.491ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
88952024-11-21T01:25:11.491ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
88962024-11-21T01:25:11.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88972024-11-21T01:25:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88982024-11-21T01:25:11.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88992024-11-21T01:25:11.493ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89002024-11-21T01:25:11.493ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89012024-11-21T01:25:11.493ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 189.45603ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89022024-11-21T01:25:11.493ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89032024-11-21T01:25:11.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89042024-11-21T01:25:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89052024-11-21T01:25:11.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89062024-11-21T01:25:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89072024-11-21T01:25:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89082024-11-21T01:25:11.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89092024-11-21T01:25:11.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89102024-11-21T01:25:11.498ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
89112024-11-21T01:25:11.498ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
89122024-11-21T01:25:11.498ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
89132024-11-21T01:25:11.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 194.41637ms iteration = 9 status = {"generation":1}
89142024-11-21T01:25:11.498ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
89152024-11-21T01:25:11.498ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
89162024-11-21T01:25:11.498ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
89172024-11-21T01:25:11.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 195.207411ms iteration = 9 status = {"generation":2}
89182024-11-21T01:25:11.523ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
89192024-11-21T01:25:11.523ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 219.684336ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
89202024-11-21T01:25:11.534ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 230.576599ms iteration = 19 status = {"physical_disks_added":0}
89212024-11-21T01:25:11.549ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89222024-11-21T01:25:11.553ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89232024-11-21T01:25:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89242024-11-21T01:25:11.555ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89252024-11-21T01:25:11.557ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89262024-11-21T01:25:11.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89272024-11-21T01:25:11.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89282024-11-21T01:25:11.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89292024-11-21T01:25:11.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89302024-11-21T01:25:11.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89312024-11-21T01:25:11.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89322024-11-21T01:25:11.583ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89332024-11-21T01:25:11.584ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "acb410f5-577e-45a4-bf82-a8189d7e8b7b", "date": "Thu, 21 Nov 2024 01:25:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89342024-11-21T01:25:11.584ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89352024-11-21T01:25:11.585ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8b862c0e-5d76-494c-93fa-fff2f3f26848", "date": "Thu, 21 Nov 2024 01:25:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89362024-11-21T01:25:11.585ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89372024-11-21T01:25:11.586ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
89382024-11-21T01:25:11.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 283.338613ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89392024-11-21T01:25:11.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 37f4a67a-bb57-488e-a73f-3abce47005f8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
89402024-11-21T01:25:11.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 37f4a67a-bb57-488e-a73f-3abce47005f8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
89412024-11-21T01:25:11.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 37f4a67a-bb57-488e-a73f-3abce47005f8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
89422024-11-21T01:25:11.663ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89432024-11-21T01:25:11.663ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89442024-11-21T01:25:11.664ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4c4474f-8304-4c18-916d-ab8aeb283e74", "content-length": "372", "date": "Thu, 21 Nov 2024 01:25:10 GMT"} })
89452024-11-21T01:25:11.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89462024-11-21T01:25:11.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89472024-11-21T01:25:11.665ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89482024-11-21T01:25:11.665ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5faab9f5-0afb-46c5-8ca9-b3a44901cb02", "content-length": "1", "date": "Thu, 21 Nov 2024 01:25:10 GMT"} })
89492024-11-21T01:25:11.667ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89502024-11-21T01:25:11.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89512024-11-21T01:25:11.669ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 365.596252ms iteration = 17 status = null
89522024-11-21T01:25:11.704ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
89532024-11-21T01:25:11.704ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89542024-11-21T01:25:11.704ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e27c5528-72ca-4684-bb6b-c41d16668434", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
89552024-11-21T01:25:11.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89562024-11-21T01:25:11.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89572024-11-21T01:25:11.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
89582024-11-21T01:25:11.707ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89592024-11-21T01:25:11.708ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2f85d72-a29f-45b7-891a-22194a730de1", "content-length": "26", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
89602024-11-21T01:25:11.708ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89612024-11-21T01:25:11.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
89622024-11-21T01:25:11.716ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89632024-11-21T01:25:11.716ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "86fd2de0-60fc-4292-90b4-c5e6a3ca63fc", "content-length": "691", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
89642024-11-21T01:25:11.716ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
89652024-11-21T01:25:11.716ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
89662024-11-21T01:25:11.716ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
89672024-11-21T01:25:11.718ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 414.983228ms iteration = 17 status = {}
89682024-11-21T01:25:11.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89692024-11-21T01:25:11.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89702024-11-21T01:25:11.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89712024-11-21T01:25:11.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89722024-11-21T01:25:11.725ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89732024-11-21T01:25:11.725ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89742024-11-21T01:25:11.725ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86e04f25-f39c-403b-944f-3862c26e9687", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
89752024-11-21T01:25:11.727ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 423.259004ms iteration = 17 status = {}
89762024-11-21T01:25:11.813ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
89772024-11-21T01:25:11.813ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 509.986517ms iteration = 17 status = {}
89782024-11-21T01:25:11.852ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89792024-11-21T01:25:11.852ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b9647a9f-821d-4e50-bb38-280fd1819a97", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89802024-11-21T01:25:11.852ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89812024-11-21T01:25:11.854ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9c44aaba-3916-4bed-b1d8-26528c558a10", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89822024-11-21T01:25:11.854ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89832024-11-21T01:25:11.856ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3faff821-dcc1-4ced-8647-d00673d855b0", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89842024-11-21T01:25:11.856ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89852024-11-21T01:25:11.857ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89862024-11-21T01:25:11.857ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 553.362347ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
89872024-11-21T01:25:11.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89882024-11-21T01:25:11.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89892024-11-21T01:25:11.879ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
89902024-11-21T01:25:11.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89912024-11-21T01:25:11.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89922024-11-21T01:25:11.887ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89932024-11-21T01:25:11.888ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e93301d6-d88f-4047-9f12-1b3e03fcf997", "content-length": "134", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
89942024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89952024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
89962024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89972024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89982024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89992024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90002024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90012024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90022024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90032024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90042024-11-21T01:25:11.888ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
90052024-11-21T01:25:11.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90062024-11-21T01:25:11.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90072024-11-21T01:25:11.891ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90082024-11-21T01:25:11.891ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d1e0f54-6f0c-422c-9822-d5709f89fe43", "content-length": "2", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
90092024-11-21T01:25:11.891ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90102024-11-21T01:25:11.891ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "76332747-29f2-4c9d-88a2-eea41f6fa781", "content-length": "51", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
90112024-11-21T01:25:11.891ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
90122024-11-21T01:25:11.891ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90132024-11-21T01:25:11.989ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "65e9f88a-a20a-4340-a4f6-63d4fc962b44", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
90142024-11-21T01:25:11.989ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
90152024-11-21T01:25:11.989ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90162024-11-21T01:25:11.989ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eef7aab5-e99a-4476-85d1-6563c854909b", "content-length": "682", "date": "Thu, 21 Nov 2024 01:25:11 GMT"} })
90172024-11-21T01:25:11.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90182024-11-21T01:25:11.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90192024-11-21T01:25:11.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90202024-11-21T01:25:11.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90212024-11-21T01:25:11.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90222024-11-21T01:25:11.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90232024-11-21T01:25:11.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90242024-11-21T01:25:11.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90252024-11-21T01:25:12.004ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 701.334813ms iteration = 17 status = {}
90262024-11-21T01:25:12.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 99c9f778-1131-4962-9e92-5bade12610c5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90272024-11-21T01:25:12.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 99c9f778-1131-4962-9e92-5bade12610c5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90282024-11-21T01:25:12.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 99c9f778-1131-4962-9e92-5bade12610c5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90292024-11-21T01:25:13.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a5c5f93e-05aa-46b3-8e9b-c2c3799b61db roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90302024-11-21T01:25:13.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a5c5f93e-05aa-46b3-8e9b-c2c3799b61db resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90312024-11-21T01:25:13.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a5c5f93e-05aa-46b3-8e9b-c2c3799b61db response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90322024-11-21T01:25:14.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = db19e243-a82e-4102-a2db-556142d488d9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90332024-11-21T01:25:14.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = db19e243-a82e-4102-a2db-556142d488d9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90342024-11-21T01:25:14.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = db19e243-a82e-4102-a2db-556142d488d9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90352024-11-21T01:25:15.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 41065071-0f64-4b02-b9ef-698ad949b415 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90362024-11-21T01:25:15.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 41065071-0f64-4b02-b9ef-698ad949b415 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90372024-11-21T01:25:15.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 41065071-0f64-4b02-b9ef-698ad949b415 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90382024-11-21T01:25:16.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 566a91c7-1ebb-4817-90fe-05b62abd3c70 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90392024-11-21T01:25:16.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 566a91c7-1ebb-4817-90fe-05b62abd3c70 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90402024-11-21T01:25:16.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 566a91c7-1ebb-4817-90fe-05b62abd3c70 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90412024-11-21T01:25:17.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 828a8ec0-1219-4f04-a14f-f71d9a984efa roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90422024-11-21T01:25:17.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 828a8ec0-1219-4f04-a14f-f71d9a984efa resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90432024-11-21T01:25:17.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 828a8ec0-1219-4f04-a14f-f71d9a984efa response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90442024-11-21T01:25:18.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 868 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 0937e972-377a-4717-98cc-9cd41738f9f8 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
90452024-11-21T01:25:18.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b094b1b9-3eb4-4e8b-a59e-c7830625d692 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90462024-11-21T01:25:18.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b094b1b9-3eb4-4e8b-a59e-c7830625d692 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90472024-11-21T01:25:18.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b094b1b9-3eb4-4e8b-a59e-c7830625d692 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90482024-11-21T01:25:19.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b788d9b4-a01e-4728-8acf-f2c207af842f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90492024-11-21T01:25:19.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b788d9b4-a01e-4728-8acf-f2c207af842f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90502024-11-21T01:25:19.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b788d9b4-a01e-4728-8acf-f2c207af842f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90512024-11-21T01:25:20.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf43753d-ab58-40cc-8a78-af452fbd9918 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90522024-11-21T01:25:20.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf43753d-ab58-40cc-8a78-af452fbd9918 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90532024-11-21T01:25:20.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf43753d-ab58-40cc-8a78-af452fbd9918 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90542024-11-21T01:25:21.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
90552024-11-21T01:25:21.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90562024-11-21T01:25:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90572024-11-21T01:25:21.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
90582024-11-21T01:25:21.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90592024-11-21T01:25:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90602024-11-21T01:25:21.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90612024-11-21T01:25:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90622024-11-21T01:25:21.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90632024-11-21T01:25:21.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90642024-11-21T01:25:21.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90652024-11-21T01:25:21.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90662024-11-21T01:25:21.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90672024-11-21T01:25:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
90682024-11-21T01:25:21.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90692024-11-21T01:25:21.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90702024-11-21T01:25:21.325ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
90712024-11-21T01:25:21.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.511067ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
90722024-11-21T01:25:21.333ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90732024-11-21T01:25:21.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90742024-11-21T01:25:21.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.839694ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90752024-11-21T01:25:21.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 57eb7ec9-351c-4d34-bf2f-fb63a3c9f82f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90762024-11-21T01:25:21.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 57eb7ec9-351c-4d34-bf2f-fb63a3c9f82f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90772024-11-21T01:25:21.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 57eb7ec9-351c-4d34-bf2f-fb63a3c9f82f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90782024-11-21T01:25:22.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d941d4d1-d0be-4f2e-905c-264a44b3f698 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90792024-11-21T01:25:22.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d941d4d1-d0be-4f2e-905c-264a44b3f698 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90802024-11-21T01:25:22.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d941d4d1-d0be-4f2e-905c-264a44b3f698 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90812024-11-21T01:25:23.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = edbc28cc-34af-48ad-925e-c89e65154aff roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90822024-11-21T01:25:23.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = edbc28cc-34af-48ad-925e-c89e65154aff resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90832024-11-21T01:25:23.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = edbc28cc-34af-48ad-925e-c89e65154aff response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90842024-11-21T01:25:24.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fa50a7b-618a-4422-ae9b-e92f934ff037 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90852024-11-21T01:25:24.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fa50a7b-618a-4422-ae9b-e92f934ff037 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90862024-11-21T01:25:24.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fa50a7b-618a-4422-ae9b-e92f934ff037 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90872024-11-21T01:25:25.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 40c6a4f5-199c-4701-a607-c430aaeebbe5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90882024-11-21T01:25:25.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 40c6a4f5-199c-4701-a607-c430aaeebbe5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90892024-11-21T01:25:25.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 40c6a4f5-199c-4701-a607-c430aaeebbe5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90902024-11-21T01:25:26.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = afccdd82-7679-4287-852f-57275213010f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90912024-11-21T01:25:26.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = afccdd82-7679-4287-852f-57275213010f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90922024-11-21T01:25:26.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = afccdd82-7679-4287-852f-57275213010f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90932024-11-21T01:25:27.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8a604ed3-a830-4d84-9e68-9cb7e8da2104 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90942024-11-21T01:25:27.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8a604ed3-a830-4d84-9e68-9cb7e8da2104 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90952024-11-21T01:25:27.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8a604ed3-a830-4d84-9e68-9cb7e8da2104 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90962024-11-21T01:25:29.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8bef683b-62c5-48bb-a5b7-3d4ebfc5b3f1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90972024-11-21T01:25:29.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8bef683b-62c5-48bb-a5b7-3d4ebfc5b3f1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90982024-11-21T01:25:29.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8bef683b-62c5-48bb-a5b7-3d4ebfc5b3f1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
90992024-11-21T01:25:30.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 08adc972-c5dc-44ca-a76d-9d675ee9218b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91002024-11-21T01:25:30.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 08adc972-c5dc-44ca-a76d-9d675ee9218b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91012024-11-21T01:25:30.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 08adc972-c5dc-44ca-a76d-9d675ee9218b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91022024-11-21T01:25:31.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6dab579e-f900-4680-8ca2-5c1fa631f052 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91032024-11-21T01:25:31.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6dab579e-f900-4680-8ca2-5c1fa631f052 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91042024-11-21T01:25:31.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6dab579e-f900-4680-8ca2-5c1fa631f052 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91052024-11-21T01:25:31.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
91062024-11-21T01:25:31.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91072024-11-21T01:25:31.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91082024-11-21T01:25:31.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
91092024-11-21T01:25:31.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91102024-11-21T01:25:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91112024-11-21T01:25:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91122024-11-21T01:25:31.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91132024-11-21T01:25:31.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91142024-11-21T01:25:31.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.275806ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91152024-11-21T01:25:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91162024-11-21T01:25:31.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91172024-11-21T01:25:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91182024-11-21T01:25:31.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91192024-11-21T01:25:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91202024-11-21T01:25:31.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91212024-11-21T01:25:31.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
91222024-11-21T01:25:31.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91232024-11-21T01:25:31.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91242024-11-21T01:25:31.322ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
91252024-11-21T01:25:31.322ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.561416ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
91262024-11-21T01:25:32.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc936674-9ef9-4f51-9e9d-807a84496984 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91272024-11-21T01:25:32.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc936674-9ef9-4f51-9e9d-807a84496984 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91282024-11-21T01:25:32.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc936674-9ef9-4f51-9e9d-807a84496984 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91292024-11-21T01:25:33.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 73f3386b-9865-43af-9b24-deb17dacab74 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91302024-11-21T01:25:33.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 73f3386b-9865-43af-9b24-deb17dacab74 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91312024-11-21T01:25:33.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 73f3386b-9865-43af-9b24-deb17dacab74 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91322024-11-21T01:25:33.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 862 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = ed9a271e-5f5a-4cf1-ad33-adf95db24840 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
91332024-11-21T01:25:34.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 23975436-0947-4302-9f86-e7adbd18e72f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91342024-11-21T01:25:34.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 23975436-0947-4302-9f86-e7adbd18e72f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91352024-11-21T01:25:34.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 23975436-0947-4302-9f86-e7adbd18e72f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91362024-11-21T01:25:35.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ffef0a36-11b7-4ae2-99ab-c51b1eefa0da roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91372024-11-21T01:25:35.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ffef0a36-11b7-4ae2-99ab-c51b1eefa0da resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91382024-11-21T01:25:35.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ffef0a36-11b7-4ae2-99ab-c51b1eefa0da response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91392024-11-21T01:25:36.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d815775e-9ef8-4a06-8437-29ed62d6bd98 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91402024-11-21T01:25:36.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d815775e-9ef8-4a06-8437-29ed62d6bd98 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91412024-11-21T01:25:36.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d815775e-9ef8-4a06-8437-29ed62d6bd98 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91422024-11-21T01:25:37.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 300dcd18-74d7-44ed-97c4-6b1d015f7023 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91432024-11-21T01:25:37.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 300dcd18-74d7-44ed-97c4-6b1d015f7023 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91442024-11-21T01:25:37.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 300dcd18-74d7-44ed-97c4-6b1d015f7023 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91452024-11-21T01:25:38.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c22ec46e-f837-4240-b8d9-10a769716c6c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91462024-11-21T01:25:38.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c22ec46e-f837-4240-b8d9-10a769716c6c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91472024-11-21T01:25:38.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c22ec46e-f837-4240-b8d9-10a769716c6c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91482024-11-21T01:25:39.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 21ccf325-c2ae-45bd-9be0-2d5c4ff01ba0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91492024-11-21T01:25:39.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 21ccf325-c2ae-45bd-9be0-2d5c4ff01ba0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91502024-11-21T01:25:39.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 21ccf325-c2ae-45bd-9be0-2d5c4ff01ba0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91512024-11-21T01:25:40.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9cc46055-f39b-4fbb-b594-3c3c25b16b2f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91522024-11-21T01:25:40.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9cc46055-f39b-4fbb-b594-3c3c25b16b2f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91532024-11-21T01:25:40.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9cc46055-f39b-4fbb-b594-3c3c25b16b2f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91542024-11-21T01:25:41.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7607ea35-167e-4fd4-89fa-74526e88d7e6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91552024-11-21T01:25:41.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7607ea35-167e-4fd4-89fa-74526e88d7e6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91562024-11-21T01:25:41.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7607ea35-167e-4fd4-89fa-74526e88d7e6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
91572024-11-21T01:25:41.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1d1bb083-bae0-4840-8041-5a76f7b04092 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91582024-11-21T01:25:41.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1d1bb083-bae0-4840-8041-5a76f7b04092 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91592024-11-21T01:25:41.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1d1bb083-bae0-4840-8041-5a76f7b04092 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
91602024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
91612024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91622024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
91632024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
91642024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91652024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91662024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
91672024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91682024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
91692024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
91702024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91712024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91722024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
91732024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
91742024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91752024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91762024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
91772024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91782024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91792024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
91802024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91812024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91822024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91832024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91842024-11-21T01:25:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91852024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
91862024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91872024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91882024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
91892024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91902024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
91912024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
91922024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91932024-11-21T01:25:41.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91942024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91952024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91962024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91972024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91982024-11-21T01:25:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91992024-11-21T01:25:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
92002024-11-21T01:25:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
92012024-11-21T01:25:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92022024-11-21T01:25:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92032024-11-21T01:25:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
92042024-11-21T01:25:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92052024-11-21T01:25:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
92062024-11-21T01:25:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92072024-11-21T01:25:41.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92082024-11-21T01:25:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92092024-11-21T01:25:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92102024-11-21T01:25:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92112024-11-21T01:25:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92122024-11-21T01:25:41.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1520, tv_nsec: 204829347 } })
92132024-11-21T01:25:41.307ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.154848ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92142024-11-21T01:25:41.307ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
92152024-11-21T01:25:41.308ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1520, tv_nsec: 205420706 } })
92162024-11-21T01:25:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92172024-11-21T01:25:41.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92182024-11-21T01:25:41.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
92192024-11-21T01:25:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92202024-11-21T01:25:41.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92212024-11-21T01:25:41.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92222024-11-21T01:25:41.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92232024-11-21T01:25:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92242024-11-21T01:25:41.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92252024-11-21T01:25:41.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92262024-11-21T01:25:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92272024-11-21T01:25:41.313ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92282024-11-21T01:25:41.313ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92292024-11-21T01:25:41.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92302024-11-21T01:25:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92312024-11-21T01:25:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92322024-11-21T01:25:41.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92332024-11-21T01:25:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92342024-11-21T01:25:41.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92352024-11-21T01:25:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92362024-11-21T01:25:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92372024-11-21T01:25:41.315ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92382024-11-21T01:25:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92392024-11-21T01:25:41.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92402024-11-21T01:25:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92412024-11-21T01:25:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92422024-11-21T01:25:41.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.421436ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
92432024-11-21T01:25:41.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92442024-11-21T01:25:41.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92452024-11-21T01:25:41.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92462024-11-21T01:25:41.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92472024-11-21T01:25:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92482024-11-21T01:25:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92492024-11-21T01:25:41.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92502024-11-21T01:25:41.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92512024-11-21T01:25:41.321ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1520, tv_nsec: 218767394 } })
92522024-11-21T01:25:41.321ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
92532024-11-21T01:25:41.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92542024-11-21T01:25:41.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92552024-11-21T01:25:41.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92562024-11-21T01:25:41.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92572024-11-21T01:25:41.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92582024-11-21T01:25:41.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92592024-11-21T01:25:41.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92602024-11-21T01:25:41.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92612024-11-21T01:25:41.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92622024-11-21T01:25:41.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92632024-11-21T01:25:41.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92642024-11-21T01:25:41.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
92652024-11-21T01:25:41.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92662024-11-21T01:25:41.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92672024-11-21T01:25:41.344ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
92682024-11-21T01:25:41.344ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.788905ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
92692024-11-21T01:25:41.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92702024-11-21T01:25:41.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92712024-11-21T01:25:41.346ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 43.29345ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92722024-11-21T01:25:41.352ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.669378ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
92732024-11-21T01:25:41.361ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92742024-11-21T01:25:41.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92752024-11-21T01:25:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92762024-11-21T01:25:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92772024-11-21T01:25:41.364ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92782024-11-21T01:25:41.364ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92792024-11-21T01:25:41.364ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92802024-11-21T01:25:41.364ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92812024-11-21T01:25:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92822024-11-21T01:25:41.364ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92832024-11-21T01:25:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92842024-11-21T01:25:41.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92852024-11-21T01:25:41.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92862024-11-21T01:25:41.369ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.118607ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92872024-11-21T01:25:41.369ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
92882024-11-21T01:25:41.369ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.133118ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
92892024-11-21T01:25:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
92902024-11-21T01:25:41.370ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92912024-11-21T01:25:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92922024-11-21T01:25:41.372ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.712009ms iteration = 18 status = 0
92932024-11-21T01:25:41.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92942024-11-21T01:25:41.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92952024-11-21T01:25:41.394ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
92962024-11-21T01:25:41.394ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92972024-11-21T01:25:41.394ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a44dc189-c33e-4584-a495-84efe8ff5cdd", "content-length": "26", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
92982024-11-21T01:25:41.394ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92992024-11-21T01:25:41.395ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
93002024-11-21T01:25:41.395ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93012024-11-21T01:25:41.395ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca5bb283-caf8-4478-ba00-853d5dc948f7", "content-length": "26", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93022024-11-21T01:25:41.395ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93032024-11-21T01:25:41.396ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93042024-11-21T01:25:41.397ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93052024-11-21T01:25:41.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93062024-11-21T01:25:41.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93072024-11-21T01:25:41.402ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93082024-11-21T01:25:41.402ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93092024-11-21T01:25:41.402ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.210455ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93102024-11-21T01:25:41.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.494068ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93112024-11-21T01:25:41.420ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
93122024-11-21T01:25:41.420ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93132024-11-21T01:25:41.420ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53e8444-89d1-4fea-a42e-b789ca1822e8", "content-length": "26", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93142024-11-21T01:25:41.420ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93152024-11-21T01:25:41.421ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
93162024-11-21T01:25:41.450ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.495208ms iteration = 20 status = {"physical_disks_added":0}
93172024-11-21T01:25:41.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93182024-11-21T01:25:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93192024-11-21T01:25:41.522ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93202024-11-21T01:25:41.522ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba6034b5-9481-4357-8a05-4c4fefa9a6d1", "content-length": "1", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93212024-11-21T01:25:41.524ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93222024-11-21T01:25:41.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93232024-11-21T01:25:41.609ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93242024-11-21T01:25:41.609ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93252024-11-21T01:25:41.609ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ba4d2ab-7fe7-4834-a784-73680ab6b61b", "content-length": "372", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93262024-11-21T01:25:41.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93272024-11-21T01:25:41.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93282024-11-21T01:25:41.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93292024-11-21T01:25:41.612ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 309.234678ms iteration = 18 status = null
93302024-11-21T01:25:41.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93312024-11-21T01:25:41.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93322024-11-21T01:25:41.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93332024-11-21T01:25:41.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93342024-11-21T01:25:41.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93352024-11-21T01:25:41.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93362024-11-21T01:25:41.616ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.487078ms iteration = 18 status = {}
93372024-11-21T01:25:41.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93382024-11-21T01:25:41.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 332.100891ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93392024-11-21T01:25:41.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93402024-11-21T01:25:41.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93412024-11-21T01:25:41.649ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
93422024-11-21T01:25:41.649ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93432024-11-21T01:25:41.649ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cc15754f-a9cf-4a8b-95d5-dc1376ded705", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93442024-11-21T01:25:41.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93452024-11-21T01:25:41.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93462024-11-21T01:25:41.651ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
93472024-11-21T01:25:41.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93482024-11-21T01:25:41.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93492024-11-21T01:25:41.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93502024-11-21T01:25:41.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93512024-11-21T01:25:41.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93522024-11-21T01:25:41.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93532024-11-21T01:25:41.657ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93542024-11-21T01:25:41.657ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93552024-11-21T01:25:41.657ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b78fceb-55e4-4536-80a2-99750e70a159", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93562024-11-21T01:25:41.659ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 354.81163ms iteration = 18 status = {}
93572024-11-21T01:25:41.661ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93582024-11-21T01:25:41.661ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d6f23b4-8832-4d46-9822-7e7cc61204f7", "content-length": "134", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93592024-11-21T01:25:41.661ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93602024-11-21T01:25:41.661ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
93612024-11-21T01:25:41.661ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93622024-11-21T01:25:41.661ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93632024-11-21T01:25:41.661ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93642024-11-21T01:25:41.661ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93652024-11-21T01:25:41.661ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93662024-11-21T01:25:41.661ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93672024-11-21T01:25:41.662ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93682024-11-21T01:25:41.662ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93692024-11-21T01:25:41.662ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
93702024-11-21T01:25:41.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93712024-11-21T01:25:41.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93722024-11-21T01:25:41.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93732024-11-21T01:25:41.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d76975d2-3d0a-4aac-859c-b33b92843da3", "content-length": "2", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93742024-11-21T01:25:41.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93752024-11-21T01:25:41.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b199eb64-048f-499a-afe4-e203b5e15742", "content-length": "51", "date": "Thu, 21 Nov 2024 01:25:40 GMT"} })
93762024-11-21T01:25:41.664ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
93772024-11-21T01:25:41.664ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93782024-11-21T01:25:41.704ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93792024-11-21T01:25:41.774ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fc66ea89-7485-4ba9-9243-f755e4573585", "date": "Thu, 21 Nov 2024 01:25:41 GMT"} })
93802024-11-21T01:25:41.774ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
93812024-11-21T01:25:41.774ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93822024-11-21T01:25:41.774ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bf2f917-2566-4931-8f9e-745dba3a3957", "content-length": "691", "date": "Thu, 21 Nov 2024 01:25:41 GMT"} })
93832024-11-21T01:25:41.774ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
93842024-11-21T01:25:41.774ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
93852024-11-21T01:25:41.774ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
93862024-11-21T01:25:41.774ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cec4dfd-d427-44b3-885b-8e1125fadb9c", "content-length": "682", "date": "Thu, 21 Nov 2024 01:25:41 GMT"} })
93872024-11-21T01:25:41.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93882024-11-21T01:25:41.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93892024-11-21T01:25:41.776ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 473.008336ms iteration = 18 status = {}
93902024-11-21T01:25:41.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93912024-11-21T01:25:41.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93922024-11-21T01:25:41.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93932024-11-21T01:25:41.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93942024-11-21T01:25:41.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93952024-11-21T01:25:41.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93962024-11-21T01:25:41.791ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 487.756463ms iteration = 18 status = {}
93972024-11-21T01:25:41.891ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
93982024-11-21T01:25:41.891ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
93992024-11-21T01:25:41.921ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
94002024-11-21T01:25:41.921ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:57128
94012024-11-21T01:25:41.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57128 req_id = bdf3f2cd-a1cb-4275-a8ab-38e3e4d53168 roles = RoleSet { roles: {} } uri = /metrics/producers
94022024-11-21T01:25:41.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57128 req_id = bdf3f2cd-a1cb-4275-a8ab-38e3e4d53168 resource = Database result = Ok(()) uri = /metrics/producers
94032024-11-21T01:25:41.961ZINFOnexus: assigned collector to new producer collector_id = 49435a09-4a28-49d2-bf6d-81a21cb92fe2 file = nexus/src/app/oximeter.rs:76 producer_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
94042024-11-21T01:25:41.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39375 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:57128 req_id = bdf3f2cd-a1cb-4275-a8ab-38e3e4d53168 response_code = 201 uri = /metrics/producers
94052024-11-21T01:25:41.961ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bdf3f2cd-a1cb-4275-a8ab-38e3e4d53168", "content-length": "41", "date": "Thu, 21 Nov 2024 01:25:41 GMT"} })
94062024-11-21T01:25:41.962ZDEBGnexus (producer-registration-task): registered with nexus successfully
94072024-11-21T01:25:41.962ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
94082024-11-21T01:25:42.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf1e9d6d-df84-4d76-9ffc-f025cb772922 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94092024-11-21T01:25:42.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf1e9d6d-df84-4d76-9ffc-f025cb772922 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94102024-11-21T01:25:42.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cf1e9d6d-df84-4d76-9ffc-f025cb772922 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94112024-11-21T01:25:43.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c4bcfbd9-4742-42b4-9716-fb565c185f06 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94122024-11-21T01:25:43.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c4bcfbd9-4742-42b4-9716-fb565c185f06 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94132024-11-21T01:25:43.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c4bcfbd9-4742-42b4-9716-fb565c185f06 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94142024-11-21T01:25:44.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 568827ba-4b35-4a1d-b118-f1ee80197903 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94152024-11-21T01:25:44.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 568827ba-4b35-4a1d-b118-f1ee80197903 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94162024-11-21T01:25:44.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 568827ba-4b35-4a1d-b118-f1ee80197903 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94172024-11-21T01:25:45.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a3ca286-1934-463f-b83b-35bbfed18196 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94182024-11-21T01:25:45.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a3ca286-1934-463f-b83b-35bbfed18196 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94192024-11-21T01:25:45.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5a3ca286-1934-463f-b83b-35bbfed18196 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94202024-11-21T01:25:46.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b99b587c-5606-4283-8cbb-79d82af126b3 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94212024-11-21T01:25:46.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b99b587c-5606-4283-8cbb-79d82af126b3 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94222024-11-21T01:25:46.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b99b587c-5606-4283-8cbb-79d82af126b3 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94232024-11-21T01:25:47.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b07cda1f-39f0-4aef-bac3-8b5c4d79a46b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94242024-11-21T01:25:47.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b07cda1f-39f0-4aef-bac3-8b5c4d79a46b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94252024-11-21T01:25:47.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b07cda1f-39f0-4aef-bac3-8b5c4d79a46b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94262024-11-21T01:25:48.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5ec8eeb-2407-4439-bab5-7513ffccc3e7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94272024-11-21T01:25:48.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5ec8eeb-2407-4439-bab5-7513ffccc3e7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94282024-11-21T01:25:48.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1649 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5ec8eeb-2407-4439-bab5-7513ffccc3e7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94292024-11-21T01:25:48.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 56a827ce-8f22-4c2e-b47c-acf8e617790f response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
94302024-11-21T01:25:49.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e159bc05-2ffa-4ef7-8922-4c2668b183a5 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94312024-11-21T01:25:49.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e159bc05-2ffa-4ef7-8922-4c2668b183a5 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94322024-11-21T01:25:49.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e159bc05-2ffa-4ef7-8922-4c2668b183a5 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94332024-11-21T01:25:50.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f61f44c-6240-4e67-82c4-ebf1f6b77928 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94342024-11-21T01:25:50.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f61f44c-6240-4e67-82c4-ebf1f6b77928 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94352024-11-21T01:25:50.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f61f44c-6240-4e67-82c4-ebf1f6b77928 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94362024-11-21T01:25:51.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
94372024-11-21T01:25:51.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94382024-11-21T01:25:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94392024-11-21T01:25:51.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
94402024-11-21T01:25:51.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94412024-11-21T01:25:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94422024-11-21T01:25:51.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94432024-11-21T01:25:51.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94442024-11-21T01:25:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94452024-11-21T01:25:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94462024-11-21T01:25:51.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94472024-11-21T01:25:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94482024-11-21T01:25:51.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94492024-11-21T01:25:51.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94502024-11-21T01:25:51.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94512024-11-21T01:25:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
94522024-11-21T01:25:51.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94532024-11-21T01:25:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94542024-11-21T01:25:51.322ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
94552024-11-21T01:25:51.322ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.392603ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
94562024-11-21T01:25:51.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.733533ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94572024-11-21T01:25:51.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d8b2a5c-a561-4007-b8a9-984c3009c339 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94582024-11-21T01:25:51.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d8b2a5c-a561-4007-b8a9-984c3009c339 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94592024-11-21T01:25:51.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d8b2a5c-a561-4007-b8a9-984c3009c339 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94602024-11-21T01:25:52.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a34aa5d9-edeb-4210-8756-b2e4e8b68cb0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94612024-11-21T01:25:52.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a34aa5d9-edeb-4210-8756-b2e4e8b68cb0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94622024-11-21T01:25:52.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a34aa5d9-edeb-4210-8756-b2e4e8b68cb0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94632024-11-21T01:25:53.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cc63385e-8d6a-4b97-a1b7-2e651441ff49 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94642024-11-21T01:25:53.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cc63385e-8d6a-4b97-a1b7-2e651441ff49 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94652024-11-21T01:25:53.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cc63385e-8d6a-4b97-a1b7-2e651441ff49 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94662024-11-21T01:25:54.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 61fe8459-18ad-40e2-b45c-33cab6c59e3f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94672024-11-21T01:25:54.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 61fe8459-18ad-40e2-b45c-33cab6c59e3f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94682024-11-21T01:25:54.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 61fe8459-18ad-40e2-b45c-33cab6c59e3f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94692024-11-21T01:25:55.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8fc0f343-120e-4098-8acd-06becf0cc9e9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94702024-11-21T01:25:55.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8fc0f343-120e-4098-8acd-06becf0cc9e9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94712024-11-21T01:25:55.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8fc0f343-120e-4098-8acd-06becf0cc9e9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94722024-11-21T01:25:56.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c23c2b16-d131-4203-aae3-7bd6f0f3931c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94732024-11-21T01:25:56.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c23c2b16-d131-4203-aae3-7bd6f0f3931c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94742024-11-21T01:25:56.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c23c2b16-d131-4203-aae3-7bd6f0f3931c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94752024-11-21T01:25:57.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6632f2e-3268-40af-960f-a82f007a8413 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94762024-11-21T01:25:57.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6632f2e-3268-40af-960f-a82f007a8413 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94772024-11-21T01:25:57.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6632f2e-3268-40af-960f-a82f007a8413 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94782024-11-21T01:25:58.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d5613aa1-ce05-4c61-97d2-06ffb93e01d2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94792024-11-21T01:25:58.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d5613aa1-ce05-4c61-97d2-06ffb93e01d2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94802024-11-21T01:25:58.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d5613aa1-ce05-4c61-97d2-06ffb93e01d2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94812024-11-21T01:25:59.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e295cf4-332a-4421-8e9a-966be2399458 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94822024-11-21T01:25:59.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e295cf4-332a-4421-8e9a-966be2399458 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94832024-11-21T01:25:59.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e295cf4-332a-4421-8e9a-966be2399458 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94842024-11-21T01:26:00.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05da0ea3-9cd6-455e-bf59-c3e02b935c2e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94852024-11-21T01:26:00.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05da0ea3-9cd6-455e-bf59-c3e02b935c2e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94862024-11-21T01:26:00.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 05da0ea3-9cd6-455e-bf59-c3e02b935c2e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
94872024-11-21T01:26:01.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
94882024-11-21T01:26:01.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94892024-11-21T01:26:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94902024-11-21T01:26:01.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
94912024-11-21T01:26:01.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94922024-11-21T01:26:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94932024-11-21T01:26:01.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94942024-11-21T01:26:01.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94952024-11-21T01:26:01.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94962024-11-21T01:26:01.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.423519ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94972024-11-21T01:26:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94982024-11-21T01:26:01.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94992024-11-21T01:26:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95002024-11-21T01:26:01.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95012024-11-21T01:26:01.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95022024-11-21T01:26:01.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95032024-11-21T01:26:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
95042024-11-21T01:26:01.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95052024-11-21T01:26:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95062024-11-21T01:26:01.325ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
95072024-11-21T01:26:01.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.851979ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
95082024-11-21T01:26:01.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 83fc0d11-77e0-43d2-b802-28e95b230b0c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95092024-11-21T01:26:01.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 83fc0d11-77e0-43d2-b802-28e95b230b0c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95102024-11-21T01:26:01.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 83fc0d11-77e0-43d2-b802-28e95b230b0c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95112024-11-21T01:26:02.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc50f331-8334-4e30-bd40-f640fe8f753c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95122024-11-21T01:26:02.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc50f331-8334-4e30-bd40-f640fe8f753c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95132024-11-21T01:26:02.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fc50f331-8334-4e30-bd40-f640fe8f753c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95142024-11-21T01:26:03.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 516 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 00a924cf-f1a0-42ef-83bc-56ffba25a564 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
95152024-11-21T01:26:03.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1db59ab-efc1-4c49-8eb3-471b1916427c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95162024-11-21T01:26:03.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1db59ab-efc1-4c49-8eb3-471b1916427c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95172024-11-21T01:26:03.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1db59ab-efc1-4c49-8eb3-471b1916427c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95182024-11-21T01:26:04.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6ece771-fd0a-49f9-9472-45492600b557 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95192024-11-21T01:26:04.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6ece771-fd0a-49f9-9472-45492600b557 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95202024-11-21T01:26:04.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6ece771-fd0a-49f9-9472-45492600b557 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95212024-11-21T01:26:05.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdc3a6db-b562-4a3a-9be7-8791fa056f27 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95222024-11-21T01:26:05.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdc3a6db-b562-4a3a-9be7-8791fa056f27 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95232024-11-21T01:26:05.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cdc3a6db-b562-4a3a-9be7-8791fa056f27 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95242024-11-21T01:26:06.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a3d9ade6-6906-4fb7-ae35-d73b8842de27 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95252024-11-21T01:26:06.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a3d9ade6-6906-4fb7-ae35-d73b8842de27 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95262024-11-21T01:26:06.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a3d9ade6-6906-4fb7-ae35-d73b8842de27 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95272024-11-21T01:26:07.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1da7a81e-bd2a-4136-9933-a5049531cea4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95282024-11-21T01:26:07.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1da7a81e-bd2a-4136-9933-a5049531cea4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95292024-11-21T01:26:07.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1da7a81e-bd2a-4136-9933-a5049531cea4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95302024-11-21T01:26:08.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 3b8fbf70-461d-48ef-bf40-fba3d2237f49 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
95312024-11-21T01:26:08.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 3b8fbf70-461d-48ef-bf40-fba3d2237f49 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
95322024-11-21T01:26:08.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 3b8fbf70-461d-48ef-bf40-fba3d2237f49 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
95332024-11-21T01:26:08.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 80ff2907-9615-4ff7-9863-d8d8f8f8b33c roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
95342024-11-21T01:26:08.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 80ff2907-9615-4ff7-9863-d8d8f8f8b33c resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
95352024-11-21T01:26:08.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 80ff2907-9615-4ff7-9863-d8d8f8f8b33c response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
95362024-11-21T01:26:08.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4ae85b16-9b39-4caf-8e87-06eeac0a79b2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95372024-11-21T01:26:08.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4ae85b16-9b39-4caf-8e87-06eeac0a79b2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95382024-11-21T01:26:08.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4ae85b16-9b39-4caf-8e87-06eeac0a79b2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95392024-11-21T01:26:09.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a00a79ef-a50e-40e0-ad4c-23e98da5f1b3 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95402024-11-21T01:26:09.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a00a79ef-a50e-40e0-ad4c-23e98da5f1b3 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95412024-11-21T01:26:09.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a00a79ef-a50e-40e0-ad4c-23e98da5f1b3 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95422024-11-21T01:26:11.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e454fcd-4158-425a-ae13-58ed30db76c3 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95432024-11-21T01:26:11.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e454fcd-4158-425a-ae13-58ed30db76c3 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95442024-11-21T01:26:11.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e454fcd-4158-425a-ae13-58ed30db76c3 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
95452024-11-21T01:26:11.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 9cb03477-70b0-4cfc-9edc-9e51de115977 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
95462024-11-21T01:26:11.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 9cb03477-70b0-4cfc-9edc-9e51de115977 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
95472024-11-21T01:26:11.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 9cb03477-70b0-4cfc-9edc-9e51de115977 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
95482024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
95492024-11-21T01:26:11.303ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
95502024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
95512024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.651\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
95522024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
95532024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
95542024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95552024-11-21T01:26:11.303ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:16:11.303113824 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95562024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
95572024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95582024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
95592024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95602024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95612024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
95622024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
95632024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95642024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95652024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
95662024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95672024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
95682024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
95692024-11-21T01:26:11.303ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
95702024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
95712024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
95722024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
95732024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
95742024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95752024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95762024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
95772024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
95782024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95792024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
95802024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
95812024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95822024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
95832024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
95842024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
95852024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95862024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
95872024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95882024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
95892024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95902024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95912024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95922024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95932024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95942024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95952024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95962024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
95972024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95982024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
95992024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96002024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96012024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96022024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96032024-11-21T01:26:11.303ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 201079613 } })
96042024-11-21T01:26:11.303ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 201097494 } })
96052024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
96062024-11-21T01:26:11.303ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
96072024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
96082024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
96092024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96102024-11-21T01:26:11.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96112024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96122024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96132024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96142024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
96152024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96162024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96172024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96182024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96192024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96202024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96212024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
96222024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96232024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.007614ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
96242024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96252024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96262024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96272024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96282024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
96292024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.344849ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
96302024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96312024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96322024-11-21T01:26:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96332024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
96342024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
96352024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96362024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96372024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
96382024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96392024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
96402024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96412024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
96422024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96432024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
96442024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96452024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96462024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96472024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96482024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96492024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96502024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96512024-11-21T01:26:11.305ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:16:11.303113824 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96522024-11-21T01:26:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.83755ms iteration = 10 status = {"expiration":"2024-11-21T01:16:11.303113824Z","pruned":[]}
96532024-11-21T01:26:11.306ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96542024-11-21T01:26:11.306ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 203976264 } })
96552024-11-21T01:26:11.307ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
96562024-11-21T01:26:11.307ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.993366ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96572024-11-21T01:26:11.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96582024-11-21T01:26:11.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96592024-11-21T01:26:11.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96602024-11-21T01:26:11.308ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 205426455 } })
96612024-11-21T01:26:11.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96622024-11-21T01:26:11.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
96632024-11-21T01:26:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96642024-11-21T01:26:11.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96652024-11-21T01:26:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96662024-11-21T01:26:11.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96672024-11-21T01:26:11.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96682024-11-21T01:26:11.311ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96692024-11-21T01:26:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96702024-11-21T01:26:11.312ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96712024-11-21T01:26:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96722024-11-21T01:26:11.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96732024-11-21T01:26:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96742024-11-21T01:26:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96752024-11-21T01:26:11.313ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96762024-11-21T01:26:11.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96772024-11-21T01:26:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96782024-11-21T01:26:11.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96792024-11-21T01:26:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96802024-11-21T01:26:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96812024-11-21T01:26:11.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96822024-11-21T01:26:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96832024-11-21T01:26:11.316ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96842024-11-21T01:26:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96852024-11-21T01:26:11.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96862024-11-21T01:26:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96872024-11-21T01:26:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96882024-11-21T01:26:11.319ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96892024-11-21T01:26:11.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96902024-11-21T01:26:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96912024-11-21T01:26:11.319ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96922024-11-21T01:26:11.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96932024-11-21T01:26:11.319ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96942024-11-21T01:26:11.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96952024-11-21T01:26:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
96962024-11-21T01:26:11.322ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96972024-11-21T01:26:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
96982024-11-21T01:26:11.323ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96992024-11-21T01:26:11.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97002024-11-21T01:26:11.325ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97012024-11-21T01:26:11.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97022024-11-21T01:26:11.325ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97032024-11-21T01:26:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97042024-11-21T01:26:11.327ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97052024-11-21T01:26:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97062024-11-21T01:26:11.330ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.903862ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
97072024-11-21T01:26:11.331ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97082024-11-21T01:26:11.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97092024-11-21T01:26:11.332ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97102024-11-21T01:26:11.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97112024-11-21T01:26:11.332ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1550, tv_nsec: 229756928 } })
97122024-11-21T01:26:11.332ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
97132024-11-21T01:26:11.333ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97142024-11-21T01:26:11.334ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97152024-11-21T01:26:11.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97162024-11-21T01:26:11.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97172024-11-21T01:26:11.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97182024-11-21T01:26:11.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.868829ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97192024-11-21T01:26:11.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97202024-11-21T01:26:11.339ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97212024-11-21T01:26:11.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97222024-11-21T01:26:11.344ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97232024-11-21T01:26:11.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97242024-11-21T01:26:11.346ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97252024-11-21T01:26:11.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
97262024-11-21T01:26:11.348ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97272024-11-21T01:26:11.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97282024-11-21T01:26:11.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97292024-11-21T01:26:11.358ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97302024-11-21T01:26:11.358ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97312024-11-21T01:26:11.358ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97322024-11-21T01:26:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97332024-11-21T01:26:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
97342024-11-21T01:26:11.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97352024-11-21T01:26:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97362024-11-21T01:26:11.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97372024-11-21T01:26:11.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97382024-11-21T01:26:11.360ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97392024-11-21T01:26:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97402024-11-21T01:26:11.362ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97412024-11-21T01:26:11.362ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 58.805449ms iteration = 5 status = {"nsuccess":5}
97422024-11-21T01:26:11.362ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97432024-11-21T01:26:11.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97442024-11-21T01:26:11.363ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97452024-11-21T01:26:11.363ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97462024-11-21T01:26:11.363ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97472024-11-21T01:26:11.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97482024-11-21T01:26:11.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97492024-11-21T01:26:11.364ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97502024-11-21T01:26:11.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97512024-11-21T01:26:11.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97522024-11-21T01:26:11.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.034832ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97532024-11-21T01:26:11.367ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97542024-11-21T01:26:11.367ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97552024-11-21T01:26:11.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97562024-11-21T01:26:11.367ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97572024-11-21T01:26:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97582024-11-21T01:26:11.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97592024-11-21T01:26:11.369ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97602024-11-21T01:26:11.369ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97612024-11-21T01:26:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97622024-11-21T01:26:11.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.636265ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
97632024-11-21T01:26:11.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97642024-11-21T01:26:11.371ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97652024-11-21T01:26:11.371ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97662024-11-21T01:26:11.371ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.287514ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97672024-11-21T01:26:11.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97682024-11-21T01:26:11.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97692024-11-21T01:26:11.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.566788ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
97702024-11-21T01:26:11.372ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
97712024-11-21T01:26:11.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.251216ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
97722024-11-21T01:26:11.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97732024-11-21T01:26:11.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97742024-11-21T01:26:11.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97752024-11-21T01:26:11.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97762024-11-21T01:26:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97772024-11-21T01:26:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97782024-11-21T01:26:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97792024-11-21T01:26:11.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97802024-11-21T01:26:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97812024-11-21T01:26:11.378ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97822024-11-21T01:26:11.378ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97832024-11-21T01:26:11.378ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.325688ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97842024-11-21T01:26:11.379ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97852024-11-21T01:26:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97862024-11-21T01:26:11.379ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97872024-11-21T01:26:11.379ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97882024-11-21T01:26:11.379ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.673481ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97892024-11-21T01:26:11.379ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
97902024-11-21T01:26:11.379ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 76.805142ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
97912024-11-21T01:26:11.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97922024-11-21T01:26:11.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97932024-11-21T01:26:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97942024-11-21T01:26:11.380ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97952024-11-21T01:26:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
97962024-11-21T01:26:11.383ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97972024-11-21T01:26:11.384ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97982024-11-21T01:26:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97992024-11-21T01:26:11.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98002024-11-21T01:26:11.385ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.394612ms iteration = 19 status = 0
98012024-11-21T01:26:11.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98022024-11-21T01:26:11.386ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98032024-11-21T01:26:11.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98042024-11-21T01:26:11.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98052024-11-21T01:26:11.387ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98062024-11-21T01:26:11.387ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98072024-11-21T01:26:11.387ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98082024-11-21T01:26:11.387ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98092024-11-21T01:26:11.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98102024-11-21T01:26:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98112024-11-21T01:26:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98122024-11-21T01:26:11.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.100209ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
98132024-11-21T01:26:11.410ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98142024-11-21T01:26:11.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98152024-11-21T01:26:11.413ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98162024-11-21T01:26:11.413ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98172024-11-21T01:26:11.413ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.840928ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98182024-11-21T01:26:11.422ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98192024-11-21T01:26:11.422ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98202024-11-21T01:26:11.422ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98212024-11-21T01:26:11.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98222024-11-21T01:26:11.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98232024-11-21T01:26:11.441ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98242024-11-21T01:26:11.441ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 137.758191ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98252024-11-21T01:26:11.460ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
98262024-11-21T01:26:11.460ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
98272024-11-21T01:26:11.460ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98282024-11-21T01:26:11.460ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "883f2aea-db5d-4e83-be05-c2f6a76a2965", "content-length": "26", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
98292024-11-21T01:26:11.460ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98302024-11-21T01:26:11.463ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98312024-11-21T01:26:11.521ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
98322024-11-21T01:26:11.521ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98332024-11-21T01:26:11.522ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5c8194f-5499-46c7-b5be-d330da4b06be", "content-length": "26", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
98342024-11-21T01:26:11.522ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98352024-11-21T01:26:11.523ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
98362024-11-21T01:26:11.553ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98372024-11-21T01:26:11.553ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98382024-11-21T01:26:11.554ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecfa753a-1afd-4a17-abe7-cf22de539ecf", "content-length": "372", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
98392024-11-21T01:26:11.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98402024-11-21T01:26:11.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98412024-11-21T01:26:11.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98422024-11-21T01:26:11.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98432024-11-21T01:26:11.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98442024-11-21T01:26:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98452024-11-21T01:26:11.562ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 259.374175ms iteration = 21 status = {"physical_disks_added":0}
98462024-11-21T01:26:11.585ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98472024-11-21T01:26:11.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 283.572896ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98482024-11-21T01:26:11.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98492024-11-21T01:26:11.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98502024-11-21T01:26:11.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98512024-11-21T01:26:11.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98522024-11-21T01:26:11.596ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98532024-11-21T01:26:11.596ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
98542024-11-21T01:26:11.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98552024-11-21T01:26:11.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98562024-11-21T01:26:11.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98572024-11-21T01:26:11.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98582024-11-21T01:26:11.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98592024-11-21T01:26:11.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98602024-11-21T01:26:11.605ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
98612024-11-21T01:26:11.605ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98622024-11-21T01:26:11.605ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
98632024-11-21T01:26:11.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 302.081707ms iteration = 10 status = {"generation":2}
98642024-11-21T01:26:11.615ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98652024-11-21T01:26:11.615ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98662024-11-21T01:26:11.620ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
98672024-11-21T01:26:11.620ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98682024-11-21T01:26:11.620ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9520b2fc-0f6a-4f6c-b047-f7cdc75c36a8", "content-length": "26", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
98692024-11-21T01:26:11.620ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98702024-11-21T01:26:11.622ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98712024-11-21T01:26:11.629ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98722024-11-21T01:26:11.629ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98732024-11-21T01:26:11.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98742024-11-21T01:26:11.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98752024-11-21T01:26:11.630ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
98762024-11-21T01:26:11.630ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b97683ff-7e59-4c20-afef-2ffa89f6af12", "date": "Thu, 21 Nov 2024 01:26:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
98772024-11-21T01:26:11.630ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
98782024-11-21T01:26:11.631ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98792024-11-21T01:26:11.632ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4665c1e0-7d5f-4c89-ad6c-721cc6dfaca4", "date": "Thu, 21 Nov 2024 01:26:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
98802024-11-21T01:26:11.632ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
98812024-11-21T01:26:11.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98822024-11-21T01:26:11.634ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98832024-11-21T01:26:11.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98842024-11-21T01:26:11.634ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
98852024-11-21T01:26:11.634ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 331.538852ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
98862024-11-21T01:26:11.636ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98872024-11-21T01:26:11.636ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98882024-11-21T01:26:11.636ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
98892024-11-21T01:26:11.636ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 333.642182ms iteration = 10 status = {"generation":1}
98902024-11-21T01:26:11.708ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0122dad0-d707-4fa7-930c-67c83f73e9ee", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
98912024-11-21T01:26:11.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98922024-11-21T01:26:11.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98932024-11-21T01:26:11.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98942024-11-21T01:26:11.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98952024-11-21T01:26:11.824ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 521.168684ms iteration = 19 status = {}
98962024-11-21T01:26:11.856ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
98972024-11-21T01:26:11.903ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98982024-11-21T01:26:11.903ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbfe9c08-5bd1-4172-a4a8-f8398f296485", "content-length": "691", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
98992024-11-21T01:26:11.903ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
99002024-11-21T01:26:11.903ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
99012024-11-21T01:26:11.903ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
99022024-11-21T01:26:11.904ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 601.568987ms iteration = 19 status = {}
99032024-11-21T01:26:11.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99042024-11-21T01:26:11.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99052024-11-21T01:26:11.910ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99062024-11-21T01:26:11.910ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99072024-11-21T01:26:11.910ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "92bc7834-b916-4b83-bf07-4d2ed82ada77", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
99082024-11-21T01:26:11.912ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 608.032468ms iteration = 19 status = {}
99092024-11-21T01:26:11.931ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99102024-11-21T01:26:11.931ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2520f2cb-d9aa-4f28-9834-322eea59fc0b", "content-length": "1", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
99112024-11-21T01:26:11.933ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99122024-11-21T01:26:11.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99132024-11-21T01:26:11.935ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 632.507503ms iteration = 19 status = null
99142024-11-21T01:26:11.965ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
99152024-11-21T01:26:11.966ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5344b078-570f-4773-8eab-fa4722b2dc61", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99162024-11-21T01:26:11.966ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99172024-11-21T01:26:11.968ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c8f89509-a7b4-4815-9c3c-fbe0af4d9948", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99182024-11-21T01:26:11.968ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99192024-11-21T01:26:11.969ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "10bddd51-affd-4aa2-9240-d3751228412e", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99202024-11-21T01:26:11.969ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99212024-11-21T01:26:11.970ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
99222024-11-21T01:26:11.970ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 667.316844ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99232024-11-21T01:26:12.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99242024-11-21T01:26:12.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99252024-11-21T01:26:12.004ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
99262024-11-21T01:26:12.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99272024-11-21T01:26:12.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99282024-11-21T01:26:12.014ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99292024-11-21T01:26:12.014ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "099aa9ba-24c2-4444-a85a-92aa2925b74e", "content-length": "134", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
99302024-11-21T01:26:12.014ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99312024-11-21T01:26:12.014ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
99322024-11-21T01:26:12.014ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99332024-11-21T01:26:12.014ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99342024-11-21T01:26:12.014ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99352024-11-21T01:26:12.014ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99362024-11-21T01:26:12.014ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99372024-11-21T01:26:12.014ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99382024-11-21T01:26:12.015ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99392024-11-21T01:26:12.015ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99402024-11-21T01:26:12.015ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
99412024-11-21T01:26:12.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99422024-11-21T01:26:12.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99432024-11-21T01:26:12.017ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99442024-11-21T01:26:12.017ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b20f62f-ad6b-49d5-96f5-caf2b7af8598", "content-length": "2", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
99452024-11-21T01:26:12.017ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99462024-11-21T01:26:12.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "455625a8-3ba0-4599-a220-69e415d31e9e", "content-length": "51", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
99472024-11-21T01:26:12.018ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
99482024-11-21T01:26:12.018ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99492024-11-21T01:26:12.122ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "33001277-bd9a-4fc9-bc88-81b526082b32", "date": "Thu, 21 Nov 2024 01:26:11 GMT"} })
99502024-11-21T01:26:12.122ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
99512024-11-21T01:26:12.122ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99522024-11-21T01:26:12.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bc7e70c-28e2-4998-a6f7-0d4ba5f65d8e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99532024-11-21T01:26:12.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bc7e70c-28e2-4998-a6f7-0d4ba5f65d8e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99542024-11-21T01:26:12.123ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4689236-7288-4969-85b1-c2b1b4d0105e", "content-length": "682", "date": "Thu, 21 Nov 2024 01:26:12 GMT"} })
99552024-11-21T01:26:12.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99562024-11-21T01:26:12.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99572024-11-21T01:26:12.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7bc7e70c-28e2-4998-a6f7-0d4ba5f65d8e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99582024-11-21T01:26:12.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99592024-11-21T01:26:12.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99602024-11-21T01:26:12.131ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99612024-11-21T01:26:12.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99622024-11-21T01:26:12.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99632024-11-21T01:26:12.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99642024-11-21T01:26:12.141ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 838.134931ms iteration = 19 status = {}
99652024-11-21T01:26:13.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 32a913a6-bbb7-423d-89fd-1d1afb42ab7a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99662024-11-21T01:26:13.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 32a913a6-bbb7-423d-89fd-1d1afb42ab7a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99672024-11-21T01:26:13.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 32a913a6-bbb7-423d-89fd-1d1afb42ab7a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99682024-11-21T01:26:14.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ad3df58b-88d7-45b9-ae3c-8568358d6178 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99692024-11-21T01:26:14.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ad3df58b-88d7-45b9-ae3c-8568358d6178 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99702024-11-21T01:26:14.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ad3df58b-88d7-45b9-ae3c-8568358d6178 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99712024-11-21T01:26:15.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9cad795d-ae13-4061-8e09-58c7fef9c4a8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99722024-11-21T01:26:15.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9cad795d-ae13-4061-8e09-58c7fef9c4a8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99732024-11-21T01:26:15.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9cad795d-ae13-4061-8e09-58c7fef9c4a8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99742024-11-21T01:26:16.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a435c39-0339-4a43-b3f6-8ef9e021393a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99752024-11-21T01:26:16.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a435c39-0339-4a43-b3f6-8ef9e021393a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99762024-11-21T01:26:16.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6a435c39-0339-4a43-b3f6-8ef9e021393a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99772024-11-21T01:26:17.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b41e5681-bf3a-4fa7-9bf1-ae3070e70f0c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99782024-11-21T01:26:17.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b41e5681-bf3a-4fa7-9bf1-ae3070e70f0c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99792024-11-21T01:26:17.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b41e5681-bf3a-4fa7-9bf1-ae3070e70f0c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99802024-11-21T01:26:18.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6bf663b-6b5c-4dcf-937a-a6907d7cbabb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99812024-11-21T01:26:18.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6bf663b-6b5c-4dcf-937a-a6907d7cbabb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99822024-11-21T01:26:18.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6bf663b-6b5c-4dcf-937a-a6907d7cbabb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99832024-11-21T01:26:18.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 8e90913a-d9e8-4a40-99ef-80aba3c9234e response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
99842024-11-21T01:26:19.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 859d6fdc-c46b-44b9-aa19-b5fe8cc973e0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99852024-11-21T01:26:19.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 859d6fdc-c46b-44b9-aa19-b5fe8cc973e0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99862024-11-21T01:26:19.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 859d6fdc-c46b-44b9-aa19-b5fe8cc973e0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99872024-11-21T01:26:20.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5759f2c7-9abc-412a-a985-479d78f6e9c6 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99882024-11-21T01:26:20.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5759f2c7-9abc-412a-a985-479d78f6e9c6 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99892024-11-21T01:26:20.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5759f2c7-9abc-412a-a985-479d78f6e9c6 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99902024-11-21T01:26:21.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
99912024-11-21T01:26:21.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99922024-11-21T01:26:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99932024-11-21T01:26:21.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
99942024-11-21T01:26:21.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99952024-11-21T01:26:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99962024-11-21T01:26:21.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 017ba883-4cef-4d6c-b3a5-776233cda67f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99972024-11-21T01:26:21.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 017ba883-4cef-4d6c-b3a5-776233cda67f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99982024-11-21T01:26:21.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 017ba883-4cef-4d6c-b3a5-776233cda67f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
99992024-11-21T01:26:21.339ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100002024-11-21T01:26:21.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100012024-11-21T01:26:21.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100022024-11-21T01:26:21.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100032024-11-21T01:26:21.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100042024-11-21T01:26:21.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100052024-11-21T01:26:21.346ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100062024-11-21T01:26:21.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100072024-11-21T01:26:21.348ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100082024-11-21T01:26:21.350ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
100092024-11-21T01:26:21.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100102024-11-21T01:26:21.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100112024-11-21T01:26:21.361ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
100122024-11-21T01:26:21.361ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.970747ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
100132024-11-21T01:26:21.369ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.857574ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100142024-11-21T01:26:22.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 371295d7-a69f-4e1d-9567-a2a923f97060 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100152024-11-21T01:26:22.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 371295d7-a69f-4e1d-9567-a2a923f97060 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100162024-11-21T01:26:22.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 371295d7-a69f-4e1d-9567-a2a923f97060 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100172024-11-21T01:26:23.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 83dd9999-8371-4f60-b9d0-55c44a6cdd58 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100182024-11-21T01:26:23.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 83dd9999-8371-4f60-b9d0-55c44a6cdd58 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100192024-11-21T01:26:23.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 83dd9999-8371-4f60-b9d0-55c44a6cdd58 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100202024-11-21T01:26:23.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 01faa61b-7114-405a-b0f5-f2219b68a177 roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
100212024-11-21T01:26:23.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 01faa61b-7114-405a-b0f5-f2219b68a177 resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
100222024-11-21T01:26:23.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 01faa61b-7114-405a-b0f5-f2219b68a177 response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
100232024-11-21T01:26:23.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = b87fa1dd-e021-4356-8996-e26b6df2333c roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
100242024-11-21T01:26:23.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = b87fa1dd-e021-4356-8996-e26b6df2333c resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
100252024-11-21T01:26:23.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = b87fa1dd-e021-4356-8996-e26b6df2333c response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
100262024-11-21T01:26:24.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1cb2619b-b55b-475c-b32c-b18bc7c6c2cb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100272024-11-21T01:26:24.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1cb2619b-b55b-475c-b32c-b18bc7c6c2cb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100282024-11-21T01:26:24.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1cb2619b-b55b-475c-b32c-b18bc7c6c2cb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100292024-11-21T01:26:25.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3845bafe-90b3-42b0-adbd-e585830918d3 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100302024-11-21T01:26:25.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3845bafe-90b3-42b0-adbd-e585830918d3 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100312024-11-21T01:26:25.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3845bafe-90b3-42b0-adbd-e585830918d3 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100322024-11-21T01:26:26.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dfe8a786-9925-429a-a736-cdfc8d47bf01 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100332024-11-21T01:26:26.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dfe8a786-9925-429a-a736-cdfc8d47bf01 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100342024-11-21T01:26:26.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dfe8a786-9925-429a-a736-cdfc8d47bf01 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100352024-11-21T01:26:27.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d83994b5-92bc-4a92-96a1-eb16a59440c1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100362024-11-21T01:26:27.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d83994b5-92bc-4a92-96a1-eb16a59440c1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100372024-11-21T01:26:27.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d83994b5-92bc-4a92-96a1-eb16a59440c1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100382024-11-21T01:26:28.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1f2ab5e-2c47-4ee2-9713-2b5b5a488f50 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100392024-11-21T01:26:28.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1f2ab5e-2c47-4ee2-9713-2b5b5a488f50 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100402024-11-21T01:26:28.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1f2ab5e-2c47-4ee2-9713-2b5b5a488f50 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100412024-11-21T01:26:29.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1f405925-5b32-4f37-ba03-c57d78dd4a4a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100422024-11-21T01:26:29.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1f405925-5b32-4f37-ba03-c57d78dd4a4a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100432024-11-21T01:26:29.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1f405925-5b32-4f37-ba03-c57d78dd4a4a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100442024-11-21T01:26:30.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4cc93603-d45a-4d32-9739-7d55d6b512a1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100452024-11-21T01:26:30.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4cc93603-d45a-4d32-9739-7d55d6b512a1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100462024-11-21T01:26:30.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4cc93603-d45a-4d32-9739-7d55d6b512a1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100472024-11-21T01:26:31.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
100482024-11-21T01:26:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100492024-11-21T01:26:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100502024-11-21T01:26:31.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
100512024-11-21T01:26:31.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100522024-11-21T01:26:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100532024-11-21T01:26:31.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100542024-11-21T01:26:31.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100552024-11-21T01:26:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100562024-11-21T01:26:31.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100572024-11-21T01:26:31.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100582024-11-21T01:26:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100592024-11-21T01:26:31.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100602024-11-21T01:26:31.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100612024-11-21T01:26:31.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100622024-11-21T01:26:31.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
100632024-11-21T01:26:31.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100642024-11-21T01:26:31.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100652024-11-21T01:26:31.325ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
100662024-11-21T01:26:31.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.542434ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
100672024-11-21T01:26:31.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.244476ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100682024-11-21T01:26:31.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af8a8ec5-8b8c-4cc3-86b4-45cb1fac811d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100692024-11-21T01:26:31.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af8a8ec5-8b8c-4cc3-86b4-45cb1fac811d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100702024-11-21T01:26:31.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = af8a8ec5-8b8c-4cc3-86b4-45cb1fac811d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100712024-11-21T01:26:32.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 181d9eb4-ce15-4436-b236-2ec1061384f4 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100722024-11-21T01:26:32.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 181d9eb4-ce15-4436-b236-2ec1061384f4 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100732024-11-21T01:26:32.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 181d9eb4-ce15-4436-b236-2ec1061384f4 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100742024-11-21T01:26:33.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 838 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = c0ad14df-ebd9-401c-8bcb-65fd46ce39fa response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
100752024-11-21T01:26:33.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 49a95ad2-92b6-4200-9b3f-ead5975a71cf roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100762024-11-21T01:26:33.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 49a95ad2-92b6-4200-9b3f-ead5975a71cf resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100772024-11-21T01:26:33.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 49a95ad2-92b6-4200-9b3f-ead5975a71cf response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100782024-11-21T01:26:34.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ce34dc7-6de9-46f0-89ad-69e00e80a442 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100792024-11-21T01:26:34.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ce34dc7-6de9-46f0-89ad-69e00e80a442 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100802024-11-21T01:26:34.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5ce34dc7-6de9-46f0-89ad-69e00e80a442 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100812024-11-21T01:26:35.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3552e145-8aaf-44e0-8687-221d50101b99 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100822024-11-21T01:26:35.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3552e145-8aaf-44e0-8687-221d50101b99 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100832024-11-21T01:26:35.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3552e145-8aaf-44e0-8687-221d50101b99 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100842024-11-21T01:26:36.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a8d31a43-6dd9-4f9b-a2bb-27bb5714aa40 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100852024-11-21T01:26:36.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a8d31a43-6dd9-4f9b-a2bb-27bb5714aa40 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100862024-11-21T01:26:36.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a8d31a43-6dd9-4f9b-a2bb-27bb5714aa40 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100872024-11-21T01:26:37.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 987ffa2b-8d81-4bb8-b0e5-30028bf1efe0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100882024-11-21T01:26:37.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 987ffa2b-8d81-4bb8-b0e5-30028bf1efe0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100892024-11-21T01:26:37.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 987ffa2b-8d81-4bb8-b0e5-30028bf1efe0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100902024-11-21T01:26:38.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5b6cf9d-ab6d-4166-8c18-19b800dfd175 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100912024-11-21T01:26:38.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5b6cf9d-ab6d-4166-8c18-19b800dfd175 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100922024-11-21T01:26:38.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5b6cf9d-ab6d-4166-8c18-19b800dfd175 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100932024-11-21T01:26:39.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0784efda-90b5-4912-81c2-9262a6325b4c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100942024-11-21T01:26:39.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0784efda-90b5-4912-81c2-9262a6325b4c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100952024-11-21T01:26:39.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0784efda-90b5-4912-81c2-9262a6325b4c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100962024-11-21T01:26:40.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c481f035-2d57-4e42-9c6f-17d14ea905ce roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100972024-11-21T01:26:40.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c481f035-2d57-4e42-9c6f-17d14ea905ce resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100982024-11-21T01:26:40.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c481f035-2d57-4e42-9c6f-17d14ea905ce response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
100992024-11-21T01:26:41.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 14a4808c-1fd4-41d2-9132-63c31e0f7592 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
101002024-11-21T01:26:41.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 14a4808c-1fd4-41d2-9132-63c31e0f7592 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
101012024-11-21T01:26:41.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 14a4808c-1fd4-41d2-9132-63c31e0f7592 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
101022024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
101032024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
101042024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101052024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
101062024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101072024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101082024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
101092024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
101102024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
101112024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101122024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101132024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
101142024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101152024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101162024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
101172024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
101182024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101192024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101202024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101212024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101222024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101232024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101242024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101252024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101262024-11-21T01:26:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101272024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
101282024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
101292024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101302024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101312024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101322024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
101332024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
101342024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101352024-11-21T01:26:41.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101362024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101372024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101382024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101392024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101402024-11-21T01:26:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101412024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
101422024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101432024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
101442024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101452024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
101462024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101472024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
101482024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101492024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101502024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101512024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101522024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
101532024-11-21T01:26:41.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101542024-11-21T01:26:41.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1580, tv_nsec: 204980518 } })
101552024-11-21T01:26:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101562024-11-21T01:26:41.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101572024-11-21T01:26:41.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
101582024-11-21T01:26:41.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101592024-11-21T01:26:41.310ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1580, tv_nsec: 207371391 } })
101602024-11-21T01:26:41.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101612024-11-21T01:26:41.310ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
101622024-11-21T01:26:41.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101632024-11-21T01:26:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101642024-11-21T01:26:41.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101652024-11-21T01:26:41.313ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.536259ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101662024-11-21T01:26:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101672024-11-21T01:26:41.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101682024-11-21T01:26:41.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101692024-11-21T01:26:41.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101702024-11-21T01:26:41.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101712024-11-21T01:26:41.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.265979ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
101722024-11-21T01:26:41.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101732024-11-21T01:26:41.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101742024-11-21T01:26:41.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101752024-11-21T01:26:41.318ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101762024-11-21T01:26:41.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101772024-11-21T01:26:41.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.735383ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
101782024-11-21T01:26:41.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101792024-11-21T01:26:41.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101802024-11-21T01:26:41.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101812024-11-21T01:26:41.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101822024-11-21T01:26:41.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101832024-11-21T01:26:41.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101842024-11-21T01:26:41.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101852024-11-21T01:26:41.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101862024-11-21T01:26:41.327ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1580, tv_nsec: 224523393 } })
101872024-11-21T01:26:41.328ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
101882024-11-21T01:26:41.345ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101892024-11-21T01:26:41.345ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101902024-11-21T01:26:41.345ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101912024-11-21T01:26:41.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101922024-11-21T01:26:41.356ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101932024-11-21T01:26:41.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101942024-11-21T01:26:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101952024-11-21T01:26:41.358ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101962024-11-21T01:26:41.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101972024-11-21T01:26:41.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101982024-11-21T01:26:41.359ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101992024-11-21T01:26:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102002024-11-21T01:26:41.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102012024-11-21T01:26:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102022024-11-21T01:26:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102032024-11-21T01:26:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102042024-11-21T01:26:41.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102052024-11-21T01:26:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102062024-11-21T01:26:41.360ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
102072024-11-21T01:26:41.360ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102082024-11-21T01:26:41.360ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb00752d-a88b-495f-9fc1-2ffa5c2460cd", "content-length": "26", "date": "Thu, 21 Nov 2024 01:26:41 GMT"} })
102092024-11-21T01:26:41.360ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102102024-11-21T01:26:41.360ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102112024-11-21T01:26:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102122024-11-21T01:26:41.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102132024-11-21T01:26:41.361ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
102142024-11-21T01:26:41.361ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102152024-11-21T01:26:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102162024-11-21T01:26:41.362ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102172024-11-21T01:26:41.362ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102182024-11-21T01:26:41.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102192024-11-21T01:26:41.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102202024-11-21T01:26:41.363ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "398af2ec-1df0-4045-927e-b3a120d4c710", "content-length": "26", "date": "Thu, 21 Nov 2024 01:26:41 GMT"} })
102212024-11-21T01:26:41.363ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102222024-11-21T01:26:41.363ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102232024-11-21T01:26:41.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102242024-11-21T01:26:41.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102252024-11-21T01:26:41.364ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102262024-11-21T01:26:41.365ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102272024-11-21T01:26:41.365ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.910729ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102282024-11-21T01:26:41.365ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102292024-11-21T01:26:41.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
102302024-11-21T01:26:41.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102312024-11-21T01:26:41.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102322024-11-21T01:26:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102332024-11-21T01:26:41.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102342024-11-21T01:26:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102352024-11-21T01:26:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
102362024-11-21T01:26:41.367ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102372024-11-21T01:26:41.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102382024-11-21T01:26:41.368ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.448382ms iteration = 20 status = 0
102392024-11-21T01:26:41.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102402024-11-21T01:26:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102412024-11-21T01:26:41.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102422024-11-21T01:26:41.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102432024-11-21T01:26:41.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102442024-11-21T01:26:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102452024-11-21T01:26:41.378ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102462024-11-21T01:26:41.378ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102472024-11-21T01:26:41.378ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102482024-11-21T01:26:41.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102492024-11-21T01:26:41.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102502024-11-21T01:26:41.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102512024-11-21T01:26:41.381ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102522024-11-21T01:26:41.381ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
102532024-11-21T01:26:41.381ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.304004ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
102542024-11-21T01:26:41.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102552024-11-21T01:26:41.389ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.963458ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102562024-11-21T01:26:41.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102572024-11-21T01:26:41.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102582024-11-21T01:26:41.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.072563ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
102592024-11-21T01:26:41.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.67399ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102602024-11-21T01:26:41.392ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.672441ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
102612024-11-21T01:26:41.412ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102622024-11-21T01:26:41.412ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102632024-11-21T01:26:41.412ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.023493ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102642024-11-21T01:26:41.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
102652024-11-21T01:26:41.423ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102662024-11-21T01:26:41.423ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb1a5ab9-610b-4dfd-bd24-2b2c3950ad45", "content-length": "26", "date": "Thu, 21 Nov 2024 01:26:41 GMT"} })
102672024-11-21T01:26:41.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102682024-11-21T01:26:41.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
102692024-11-21T01:26:41.463ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.334479ms iteration = 22 status = {"physical_disks_added":0}
102702024-11-21T01:26:41.490ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 187.458211ms iteration = 20 status = {}
102712024-11-21T01:26:41.511ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102722024-11-21T01:26:41.515ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102732024-11-21T01:26:41.516ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd6bf339-11c7-40f0-80c8-b7151dac5097", "content-length": "1", "date": "Thu, 21 Nov 2024 01:26:40 GMT"} })
102742024-11-21T01:26:41.517ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102752024-11-21T01:26:41.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102762024-11-21T01:26:41.520ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102772024-11-21T01:26:41.520ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102782024-11-21T01:26:41.522ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.590665ms iteration = 20 status = null
102792024-11-21T01:26:41.535ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "578a8aac-3710-4f89-91c5-2d5c4f5df4e6", "content-length": "372", "date": "Thu, 21 Nov 2024 01:26:40 GMT"} })
102802024-11-21T01:26:41.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102812024-11-21T01:26:41.535ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "10a5bf1b-947d-4103-ba3f-6fe82b566542", "content-length": "691", "date": "Thu, 21 Nov 2024 01:26:40 GMT"} })
102822024-11-21T01:26:41.535ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
102832024-11-21T01:26:41.535ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
102842024-11-21T01:26:41.535ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
102852024-11-21T01:26:41.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102862024-11-21T01:26:41.536ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 233.537741ms iteration = 20 status = {}
102872024-11-21T01:26:41.577ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
102882024-11-21T01:26:41.577ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102892024-11-21T01:26:41.578ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "67e23d4c-a733-4b85-bf27-5ddc874a502f", "date": "Thu, 21 Nov 2024 01:26:41 GMT"} })
102902024-11-21T01:26:41.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102912024-11-21T01:26:41.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102922024-11-21T01:26:41.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102932024-11-21T01:26:41.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102942024-11-21T01:26:41.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102952024-11-21T01:26:41.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102962024-11-21T01:26:41.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102972024-11-21T01:26:41.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102982024-11-21T01:26:41.587ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102992024-11-21T01:26:41.587ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103002024-11-21T01:26:41.587ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a2a7c41c-bd8f-4e50-a6af-2e2b281af89c", "date": "Thu, 21 Nov 2024 01:26:41 GMT"} })
103012024-11-21T01:26:41.587ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
103022024-11-21T01:26:41.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103032024-11-21T01:26:41.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103042024-11-21T01:26:41.589ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.211569ms iteration = 20 status = {}
103052024-11-21T01:26:41.597ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103062024-11-21T01:26:41.597ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cd37842-103b-4198-a314-76b58fbd938c", "content-length": "134", "date": "Thu, 21 Nov 2024 01:26:40 GMT"} })
103072024-11-21T01:26:41.597ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103082024-11-21T01:26:41.597ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
103092024-11-21T01:26:41.597ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103102024-11-21T01:26:41.597ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103112024-11-21T01:26:41.597ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103122024-11-21T01:26:41.597ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103132024-11-21T01:26:41.597ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103142024-11-21T01:26:41.597ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103152024-11-21T01:26:41.598ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103162024-11-21T01:26:41.598ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103172024-11-21T01:26:41.598ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
103182024-11-21T01:26:41.598ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103192024-11-21T01:26:41.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103202024-11-21T01:26:41.600ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103212024-11-21T01:26:41.600ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ab0bf61-45b3-4ce1-9717-29c237015a23", "content-length": "2", "date": "Thu, 21 Nov 2024 01:26:40 GMT"} })
103222024-11-21T01:26:41.600ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103232024-11-21T01:26:41.600ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2caad014-a005-4860-bcac-5830c56b156d", "content-length": "51", "date": "Thu, 21 Nov 2024 01:26:40 GMT"} })
103242024-11-21T01:26:41.600ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
103252024-11-21T01:26:41.600ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103262024-11-21T01:26:41.708ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "11ebe588-f5ca-4ba2-93ea-6f5ba3fcf8e7", "date": "Thu, 21 Nov 2024 01:26:41 GMT"} })
103272024-11-21T01:26:41.708ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
103282024-11-21T01:26:41.708ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103292024-11-21T01:26:41.709ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f3394ec-49d7-441d-b266-224cbe92ccb8", "content-length": "682", "date": "Thu, 21 Nov 2024 01:26:41 GMT"} })
103302024-11-21T01:26:41.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103312024-11-21T01:26:41.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103322024-11-21T01:26:41.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103332024-11-21T01:26:41.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103342024-11-21T01:26:41.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103352024-11-21T01:26:41.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103362024-11-21T01:26:41.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103372024-11-21T01:26:41.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103382024-11-21T01:26:41.725ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 422.769167ms iteration = 20 status = {}
103392024-11-21T01:26:41.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = afdcd95d-15b0-4928-b9f8-9ea447ce9c5c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103402024-11-21T01:26:41.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = afdcd95d-15b0-4928-b9f8-9ea447ce9c5c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103412024-11-21T01:26:41.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = afdcd95d-15b0-4928-b9f8-9ea447ce9c5c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103422024-11-21T01:26:42.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4a01a1ee-fe9c-4c78-9325-c8444d6f49fd roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103432024-11-21T01:26:42.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4a01a1ee-fe9c-4c78-9325-c8444d6f49fd resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103442024-11-21T01:26:42.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4a01a1ee-fe9c-4c78-9325-c8444d6f49fd response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103452024-11-21T01:26:43.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 458c442f-9deb-46e3-84c1-cf7426e72b98 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103462024-11-21T01:26:43.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 458c442f-9deb-46e3-84c1-cf7426e72b98 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103472024-11-21T01:26:43.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 458c442f-9deb-46e3-84c1-cf7426e72b98 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103482024-11-21T01:26:44.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3ffe4218-96e9-418a-a83e-6af5ecf14903 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103492024-11-21T01:26:44.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3ffe4218-96e9-418a-a83e-6af5ecf14903 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103502024-11-21T01:26:44.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3ffe4218-96e9-418a-a83e-6af5ecf14903 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103512024-11-21T01:26:45.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e8ae91c4-0179-413d-b0a1-d982b82895cb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103522024-11-21T01:26:45.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e8ae91c4-0179-413d-b0a1-d982b82895cb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103532024-11-21T01:26:45.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e8ae91c4-0179-413d-b0a1-d982b82895cb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103542024-11-21T01:26:46.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dd54a9a6-6549-4670-b92a-303cd0cc21f2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103552024-11-21T01:26:46.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dd54a9a6-6549-4670-b92a-303cd0cc21f2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103562024-11-21T01:26:46.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dd54a9a6-6549-4670-b92a-303cd0cc21f2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103572024-11-21T01:26:47.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 40cabe43-4746-4728-a714-490e264e2ac8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103582024-11-21T01:26:47.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 40cabe43-4746-4728-a714-490e264e2ac8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103592024-11-21T01:26:47.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 40cabe43-4746-4728-a714-490e264e2ac8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103602024-11-21T01:26:48.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = c0da2347-dfbe-4519-9a2b-a112cfd29a8d response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
103612024-11-21T01:26:48.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 90ee5324-4c51-48f7-9e51-39b4b4235a18 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103622024-11-21T01:26:48.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 90ee5324-4c51-48f7-9e51-39b4b4235a18 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103632024-11-21T01:26:48.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 90ee5324-4c51-48f7-9e51-39b4b4235a18 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103642024-11-21T01:26:49.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 716d6499-db78-4b0f-9e7f-002bb646b8fe roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103652024-11-21T01:26:49.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 716d6499-db78-4b0f-9e7f-002bb646b8fe resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103662024-11-21T01:26:49.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 716d6499-db78-4b0f-9e7f-002bb646b8fe response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103672024-11-21T01:26:51.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 433a50ca-fb0b-441a-80c3-d6ac9a1c3abe roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103682024-11-21T01:26:51.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 433a50ca-fb0b-441a-80c3-d6ac9a1c3abe resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103692024-11-21T01:26:51.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 433a50ca-fb0b-441a-80c3-d6ac9a1c3abe response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103702024-11-21T01:26:51.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
103712024-11-21T01:26:51.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103722024-11-21T01:26:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103732024-11-21T01:26:51.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
103742024-11-21T01:26:51.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103752024-11-21T01:26:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103762024-11-21T01:26:51.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103772024-11-21T01:26:51.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103782024-11-21T01:26:51.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103792024-11-21T01:26:51.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103802024-11-21T01:26:51.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103812024-11-21T01:26:51.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103822024-11-21T01:26:51.338ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103832024-11-21T01:26:51.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103842024-11-21T01:26:51.339ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103852024-11-21T01:26:51.340ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.673643ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103862024-11-21T01:26:51.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
103872024-11-21T01:26:51.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103882024-11-21T01:26:51.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103892024-11-21T01:26:51.353ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
103902024-11-21T01:26:51.353ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.426117ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
103912024-11-21T01:26:52.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6eccfe8-09e3-46ce-b3da-439bb0de734a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103922024-11-21T01:26:52.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6eccfe8-09e3-46ce-b3da-439bb0de734a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103932024-11-21T01:26:52.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6eccfe8-09e3-46ce-b3da-439bb0de734a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103942024-11-21T01:26:53.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42a885d8-b91e-4190-ac82-7a6a911606d8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103952024-11-21T01:26:53.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42a885d8-b91e-4190-ac82-7a6a911606d8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103962024-11-21T01:26:53.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 42a885d8-b91e-4190-ac82-7a6a911606d8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103972024-11-21T01:26:54.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5a585be-0446-44a9-b245-3aa110b5ed77 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103982024-11-21T01:26:54.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5a585be-0446-44a9-b245-3aa110b5ed77 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
103992024-11-21T01:26:54.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f5a585be-0446-44a9-b245-3aa110b5ed77 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104002024-11-21T01:26:55.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c8ca9086-7fbc-41c8-b6c2-17edc3b0fa9e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104012024-11-21T01:26:55.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c8ca9086-7fbc-41c8-b6c2-17edc3b0fa9e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104022024-11-21T01:26:55.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c8ca9086-7fbc-41c8-b6c2-17edc3b0fa9e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104032024-11-21T01:26:56.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c82156d2-2483-4844-bfe4-e54493e6535e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104042024-11-21T01:26:56.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c82156d2-2483-4844-bfe4-e54493e6535e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104052024-11-21T01:26:56.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c82156d2-2483-4844-bfe4-e54493e6535e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104062024-11-21T01:26:57.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cca9b30-f1c6-4d9d-a612-ab6e56474384 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104072024-11-21T01:26:57.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cca9b30-f1c6-4d9d-a612-ab6e56474384 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104082024-11-21T01:26:57.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0cca9b30-f1c6-4d9d-a612-ab6e56474384 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104092024-11-21T01:26:58.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bfcb778c-6b14-4f16-ae4d-c7201974f12a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104102024-11-21T01:26:58.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bfcb778c-6b14-4f16-ae4d-c7201974f12a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104112024-11-21T01:26:58.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bfcb778c-6b14-4f16-ae4d-c7201974f12a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104122024-11-21T01:26:59.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e1d83125-29be-433d-a745-b64b2be81cdf roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104132024-11-21T01:26:59.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e1d83125-29be-433d-a745-b64b2be81cdf resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104142024-11-21T01:26:59.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e1d83125-29be-433d-a745-b64b2be81cdf response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104152024-11-21T01:27:00.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9122da7c-94d2-4a88-a9c1-91e30e66a9f2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104162024-11-21T01:27:00.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9122da7c-94d2-4a88-a9c1-91e30e66a9f2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104172024-11-21T01:27:00.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9122da7c-94d2-4a88-a9c1-91e30e66a9f2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104182024-11-21T01:27:01.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4222275f-8b0f-4873-b7c1-ff5fa292b89d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104192024-11-21T01:27:01.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4222275f-8b0f-4873-b7c1-ff5fa292b89d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104202024-11-21T01:27:01.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4222275f-8b0f-4873-b7c1-ff5fa292b89d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104212024-11-21T01:27:01.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
104222024-11-21T01:27:01.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104232024-11-21T01:27:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104242024-11-21T01:27:01.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
104252024-11-21T01:27:01.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104262024-11-21T01:27:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104272024-11-21T01:27:01.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104282024-11-21T01:27:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104292024-11-21T01:27:01.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104302024-11-21T01:27:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104312024-11-21T01:27:01.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104322024-11-21T01:27:01.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104332024-11-21T01:27:01.335ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104342024-11-21T01:27:01.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104352024-11-21T01:27:01.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104362024-11-21T01:27:01.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
104372024-11-21T01:27:01.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104382024-11-21T01:27:01.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104392024-11-21T01:27:01.359ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
104402024-11-21T01:27:01.359ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.951139ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
104412024-11-21T01:27:01.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.826909ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104422024-11-21T01:27:02.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eb1ac366-6a12-4d4f-b617-c615b1a716b7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104432024-11-21T01:27:02.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eb1ac366-6a12-4d4f-b617-c615b1a716b7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104442024-11-21T01:27:02.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eb1ac366-6a12-4d4f-b617-c615b1a716b7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104452024-11-21T01:27:03.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a2e76df0-5aa7-4593-bb7a-2365eff755d8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104462024-11-21T01:27:03.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a2e76df0-5aa7-4593-bb7a-2365eff755d8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104472024-11-21T01:27:03.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a2e76df0-5aa7-4593-bb7a-2365eff755d8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104482024-11-21T01:27:03.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 509 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 8fa4c21e-de8d-44af-aa45-40ad50daa4ae response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
104492024-11-21T01:27:04.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1bc6af1d-c19b-478c-81b9-74a5431c212a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104502024-11-21T01:27:04.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1bc6af1d-c19b-478c-81b9-74a5431c212a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104512024-11-21T01:27:04.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1bc6af1d-c19b-478c-81b9-74a5431c212a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104522024-11-21T01:27:05.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1677263-1b93-4772-950b-35d346bb3b3a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104532024-11-21T01:27:05.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1677263-1b93-4772-950b-35d346bb3b3a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104542024-11-21T01:27:05.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f1677263-1b93-4772-950b-35d346bb3b3a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104552024-11-21T01:27:06.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b89f1940-56b7-4c30-aca7-d3b2bc12c372 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104562024-11-21T01:27:06.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b89f1940-56b7-4c30-aca7-d3b2bc12c372 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104572024-11-21T01:27:06.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b89f1940-56b7-4c30-aca7-d3b2bc12c372 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104582024-11-21T01:27:07.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6575ebe3-dce8-4194-9e66-405718a726fb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104592024-11-21T01:27:07.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6575ebe3-dce8-4194-9e66-405718a726fb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104602024-11-21T01:27:07.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6575ebe3-dce8-4194-9e66-405718a726fb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104612024-11-21T01:27:08.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e3400da-3cec-46f4-9ffa-7536e422c18b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104622024-11-21T01:27:08.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e3400da-3cec-46f4-9ffa-7536e422c18b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104632024-11-21T01:27:08.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7e3400da-3cec-46f4-9ffa-7536e422c18b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104642024-11-21T01:27:09.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bdd4adb3-4d90-4c85-9b27-932db5de13b7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104652024-11-21T01:27:09.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bdd4adb3-4d90-4c85-9b27-932db5de13b7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104662024-11-21T01:27:09.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bdd4adb3-4d90-4c85-9b27-932db5de13b7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104672024-11-21T01:27:10.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f9c695db-3ae3-4692-8c90-0b1d92df9a40 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104682024-11-21T01:27:10.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f9c695db-3ae3-4692-8c90-0b1d92df9a40 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104692024-11-21T01:27:10.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f9c695db-3ae3-4692-8c90-0b1d92df9a40 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
104702024-11-21T01:27:11.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 035dccf9-75c8-498e-8bb4-2ab63061012c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
104712024-11-21T01:27:11.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 035dccf9-75c8-498e-8bb4-2ab63061012c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
104722024-11-21T01:27:11.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 035dccf9-75c8-498e-8bb4-2ab63061012c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
104732024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
104742024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
104752024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
104762024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104772024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104782024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
104792024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
104802024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
104812024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
104822024-11-21T01:27:11.304ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
104832024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104842024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
104852024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104862024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
104872024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
104882024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104892024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
104902024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
104912024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
104922024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
104932024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104942024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
104952024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
104962024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
104972024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104982024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
104992024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105002024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
105012024-11-21T01:27:11.304ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
105022024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
105032024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.98\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
105042024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
105052024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105062024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
105072024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
105082024-11-21T01:27:11.304ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:17:11.304331381 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
105092024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
105102024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105112024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
105122024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105132024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
105142024-11-21T01:27:11.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105152024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105162024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
105172024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105182024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
105192024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105202024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105212024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
105222024-11-21T01:27:11.304ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
105232024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105242024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
105252024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105262024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
105272024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105282024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105292024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105302024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105312024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105322024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105332024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105342024-11-21T01:27:11.304ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 201716101 } })
105352024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105362024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105372024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105382024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
105392024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105402024-11-21T01:27:11.304ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 201812563 } })
105412024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
105422024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105432024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105442024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105452024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105462024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105472024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105482024-11-21T01:27:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105492024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105502024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
105512024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105522024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
105532024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
105542024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
105552024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105562024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
105572024-11-21T01:27:11.305ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
105582024-11-21T01:27:11.305ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
105592024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
105602024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105612024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
105622024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105632024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
105642024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
105652024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
105662024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.129616ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
105672024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
105682024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.272198ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
105692024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105702024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105712024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
105722024-11-21T01:27:11.305ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
105732024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105742024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
105752024-11-21T01:27:11.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105762024-11-21T01:27:11.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105772024-11-21T01:27:11.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105782024-11-21T01:27:11.307ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105792024-11-21T01:27:11.308ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.477943ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105802024-11-21T01:27:11.309ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 205949751 } })
105812024-11-21T01:27:11.309ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
105822024-11-21T01:27:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105832024-11-21T01:27:11.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105842024-11-21T01:27:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105852024-11-21T01:27:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
105862024-11-21T01:27:11.310ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
105872024-11-21T01:27:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105882024-11-21T01:27:11.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105892024-11-21T01:27:11.310ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105902024-11-21T01:27:11.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105912024-11-21T01:27:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105922024-11-21T01:27:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105932024-11-21T01:27:11.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105942024-11-21T01:27:11.313ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 210525506 } })
105952024-11-21T01:27:11.313ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
105962024-11-21T01:27:11.314ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:17:11.304331381 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
105972024-11-21T01:27:11.314ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.137813ms iteration = 11 status = {"expiration":"2024-11-21T01:17:11.304331381Z","pruned":[]}
105982024-11-21T01:27:11.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105992024-11-21T01:27:11.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106002024-11-21T01:27:11.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106012024-11-21T01:27:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106022024-11-21T01:27:11.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106032024-11-21T01:27:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106042024-11-21T01:27:11.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106052024-11-21T01:27:11.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106062024-11-21T01:27:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106072024-11-21T01:27:11.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106082024-11-21T01:27:11.320ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106092024-11-21T01:27:11.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106102024-11-21T01:27:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106112024-11-21T01:27:11.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106122024-11-21T01:27:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106132024-11-21T01:27:11.324ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.854325ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
106142024-11-21T01:27:11.331ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106152024-11-21T01:27:11.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106162024-11-21T01:27:11.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106172024-11-21T01:27:11.353ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106182024-11-21T01:27:11.353ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106192024-11-21T01:27:11.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106202024-11-21T01:27:11.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106212024-11-21T01:27:11.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106222024-11-21T01:27:11.355ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106232024-11-21T01:27:11.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106242024-11-21T01:27:11.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106252024-11-21T01:27:11.357ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
106262024-11-21T01:27:11.357ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
106272024-11-21T01:27:11.357ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106282024-11-21T01:27:11.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
106292024-11-21T01:27:11.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106302024-11-21T01:27:11.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106312024-11-21T01:27:11.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106322024-11-21T01:27:11.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106332024-11-21T01:27:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106342024-11-21T01:27:11.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106352024-11-21T01:27:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106362024-11-21T01:27:11.361ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106372024-11-21T01:27:11.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106382024-11-21T01:27:11.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106392024-11-21T01:27:11.363ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106402024-11-21T01:27:11.363ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.051658ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
106412024-11-21T01:27:11.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106422024-11-21T01:27:11.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106432024-11-21T01:27:11.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106442024-11-21T01:27:11.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106452024-11-21T01:27:11.366ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
106462024-11-21T01:27:11.366ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 61.099161ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
106472024-11-21T01:27:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
106482024-11-21T01:27:11.367ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106492024-11-21T01:27:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106502024-11-21T01:27:11.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106512024-11-21T01:27:11.378ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
106522024-11-21T01:27:11.378ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
106532024-11-21T01:27:11.378ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.500316ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
106542024-11-21T01:27:11.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106552024-11-21T01:27:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106562024-11-21T01:27:11.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106572024-11-21T01:27:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106582024-11-21T01:27:11.384ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106592024-11-21T01:27:11.384ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 281011159 } })
106602024-11-21T01:27:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106612024-11-21T01:27:11.384ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
106622024-11-21T01:27:11.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106632024-11-21T01:27:11.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106642024-11-21T01:27:11.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106652024-11-21T01:27:11.387ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.577563ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
106662024-11-21T01:27:11.388ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
106672024-11-21T01:27:11.388ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
106682024-11-21T01:27:11.388ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.684763ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
106692024-11-21T01:27:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106702024-11-21T01:27:11.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106712024-11-21T01:27:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106722024-11-21T01:27:11.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106732024-11-21T01:27:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
106742024-11-21T01:27:11.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106752024-11-21T01:27:11.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106762024-11-21T01:27:11.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106772024-11-21T01:27:11.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106782024-11-21T01:27:11.401ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106792024-11-21T01:27:11.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106802024-11-21T01:27:11.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106812024-11-21T01:27:11.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106822024-11-21T01:27:11.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106832024-11-21T01:27:11.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106842024-11-21T01:27:11.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106852024-11-21T01:27:11.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
106862024-11-21T01:27:11.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106872024-11-21T01:27:11.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106882024-11-21T01:27:11.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
106892024-11-21T01:27:11.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106902024-11-21T01:27:11.411ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106912024-11-21T01:27:11.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106922024-11-21T01:27:11.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106932024-11-21T01:27:11.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 110.064341ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106942024-11-21T01:27:11.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106952024-11-21T01:27:11.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106962024-11-21T01:27:11.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106972024-11-21T01:27:11.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106982024-11-21T01:27:11.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.530995ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106992024-11-21T01:27:11.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107002024-11-21T01:27:11.417ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107012024-11-21T01:27:11.417ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
107022024-11-21T01:27:11.417ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
107032024-11-21T01:27:11.417ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
107042024-11-21T01:27:11.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107052024-11-21T01:27:11.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107062024-11-21T01:27:11.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107072024-11-21T01:27:11.420ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107082024-11-21T01:27:11.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107092024-11-21T01:27:11.420ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107102024-11-21T01:27:11.420ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.565039ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107112024-11-21T01:27:11.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107122024-11-21T01:27:11.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107132024-11-21T01:27:11.422ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107142024-11-21T01:27:11.422ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107152024-11-21T01:27:11.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107162024-11-21T01:27:11.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
107172024-11-21T01:27:11.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107182024-11-21T01:27:11.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.308627ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
107192024-11-21T01:27:11.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107202024-11-21T01:27:11.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107212024-11-21T01:27:11.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107222024-11-21T01:27:11.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107232024-11-21T01:27:11.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107242024-11-21T01:27:11.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107252024-11-21T01:27:11.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107262024-11-21T01:27:11.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107272024-11-21T01:27:11.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107282024-11-21T01:27:11.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107292024-11-21T01:27:11.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107302024-11-21T01:27:11.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
107312024-11-21T01:27:11.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107322024-11-21T01:27:11.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107332024-11-21T01:27:11.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107342024-11-21T01:27:11.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107352024-11-21T01:27:11.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107362024-11-21T01:27:11.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107372024-11-21T01:27:11.432ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
107382024-11-21T01:27:11.436ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
107392024-11-21T01:27:11.436ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
107402024-11-21T01:27:11.436ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
107412024-11-21T01:27:11.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107422024-11-21T01:27:11.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107432024-11-21T01:27:11.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107442024-11-21T01:27:11.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107452024-11-21T01:27:11.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107462024-11-21T01:27:11.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107472024-11-21T01:27:11.446ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
107482024-11-21T01:27:11.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 142.69729ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
107492024-11-21T01:27:11.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107502024-11-21T01:27:11.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107512024-11-21T01:27:11.454ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
107522024-11-21T01:27:11.454ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107532024-11-21T01:27:11.454ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "255d0af0-3e55-408b-b358-ba1bf238aceb", "content-length": "26", "date": "Thu, 21 Nov 2024 01:27:10 GMT"} })
107542024-11-21T01:27:11.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107552024-11-21T01:27:11.454ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
107562024-11-21T01:27:11.454ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107572024-11-21T01:27:11.455ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "273637a3-f875-46c3-8a8f-481222c90534", "content-length": "26", "date": "Thu, 21 Nov 2024 01:27:10 GMT"} })
107582024-11-21T01:27:11.455ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107592024-11-21T01:27:11.459ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107602024-11-21T01:27:11.459ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107612024-11-21T01:27:11.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c9a672f6-9c5e-490a-9545-11e41968c514 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
107622024-11-21T01:27:11.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c9a672f6-9c5e-490a-9545-11e41968c514 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
107632024-11-21T01:27:11.477ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107642024-11-21T01:27:11.477ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107652024-11-21T01:27:11.477ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.604522ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107662024-11-21T01:27:11.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c9a672f6-9c5e-490a-9545-11e41968c514 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
107672024-11-21T01:27:11.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107682024-11-21T01:27:11.486ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) }
107692024-11-21T01:27:11.486ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 182.142297ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
107702024-11-21T01:27:11.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107712024-11-21T01:27:11.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107722024-11-21T01:27:11.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107732024-11-21T01:27:11.488ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 182.929697ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
107742024-11-21T01:27:11.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107752024-11-21T01:27:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107762024-11-21T01:27:11.491ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
107772024-11-21T01:27:11.491ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
107782024-11-21T01:27:11.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107792024-11-21T01:27:11.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107802024-11-21T01:27:11.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107812024-11-21T01:27:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107822024-11-21T01:27:11.492ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
107832024-11-21T01:27:11.492ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
107842024-11-21T01:27:11.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107852024-11-21T01:27:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107862024-11-21T01:27:11.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107872024-11-21T01:27:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107882024-11-21T01:27:11.499ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107892024-11-21T01:27:11.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107902024-11-21T01:27:11.501ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107912024-11-21T01:27:11.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107922024-11-21T01:27:11.525ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
107932024-11-21T01:27:11.525ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 221.282719ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
107942024-11-21T01:27:11.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107952024-11-21T01:27:11.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107962024-11-21T01:27:11.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107972024-11-21T01:27:11.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107982024-11-21T01:27:11.544ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
107992024-11-21T01:27:11.544ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
108002024-11-21T01:27:11.544ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
108012024-11-21T01:27:11.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 240.498259ms iteration = 11 status = {"generation":2}
108022024-11-21T01:27:11.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108032024-11-21T01:27:11.551ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108042024-11-21T01:27:11.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
108052024-11-21T01:27:11.551ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108062024-11-21T01:27:11.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108072024-11-21T01:27:11.551ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddef6b62-6715-490c-8ebe-ae175a927fd3", "content-length": "26", "date": "Thu, 21 Nov 2024 01:27:10 GMT"} })
108082024-11-21T01:27:11.551ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108092024-11-21T01:27:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108102024-11-21T01:27:11.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108112024-11-21T01:27:11.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108122024-11-21T01:27:11.554ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
108132024-11-21T01:27:11.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108142024-11-21T01:27:11.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108152024-11-21T01:27:11.557ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(475cf7bc-78b5-49fa-afcf-1b1ea0d08443, 0), (ed4e3252-0a22-4eb1-879f-b3666090902e, 0), (0cb61ac4-a930-47cd-acd0-7c378ecac5f8, 0), (54a1b330-10e6-4410-b67b-248cae3d8173, 0)] collection_id = 475cf7bc-78b5-49fa-afcf-1b1ea0d08443
108162024-11-21T01:27:11.557ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108172024-11-21T01:27:11.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108182024-11-21T01:27:11.581ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 276.977814ms iteration = 23 status = {"physical_disks_added":0}
108192024-11-21T01:27:11.594ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
108202024-11-21T01:27:11.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108212024-11-21T01:27:11.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108222024-11-21T01:27:11.616ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.595695ms iteration = 21 status = {}
108232024-11-21T01:27:11.624ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
108242024-11-21T01:27:11.624ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0cff2c01-4eb3-4b9f-aa4f-0bae3f972393", "date": "Thu, 21 Nov 2024 01:27:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108252024-11-21T01:27:11.624ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108262024-11-21T01:27:11.624ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
108272024-11-21T01:27:11.625ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c2c431d-1141-45e1-af6e-40e01de55907", "content-length": "1", "date": "Thu, 21 Nov 2024 01:27:10 GMT"} })
108282024-11-21T01:27:11.627ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "749f87dc-f88b-4a36-b48a-e53b7c4e78a7", "date": "Thu, 21 Nov 2024 01:27:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108292024-11-21T01:27:11.627ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108302024-11-21T01:27:11.628ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108312024-11-21T01:27:11.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108322024-11-21T01:27:11.630ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
108332024-11-21T01:27:11.630ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 326.075726ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108342024-11-21T01:27:11.647ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108352024-11-21T01:27:11.647ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108362024-11-21T01:27:11.647ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6b07ea3-36a2-4694-95cb-186b11718341", "content-length": "372", "date": "Thu, 21 Nov 2024 01:27:10 GMT"} })
108372024-11-21T01:27:11.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108382024-11-21T01:27:11.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108392024-11-21T01:27:11.649ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108402024-11-21T01:27:11.650ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
108412024-11-21T01:27:11.650ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
108422024-11-21T01:27:11.650ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
108432024-11-21T01:27:11.650ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 346.581844ms iteration = 11 status = {"generation":1}
108442024-11-21T01:27:11.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
108452024-11-21T01:27:11.653ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108462024-11-21T01:27:11.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108472024-11-21T01:27:11.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108482024-11-21T01:27:11.655ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 351.352722ms iteration = 21 status = null
108492024-11-21T01:27:11.656ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108502024-11-21T01:27:11.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108512024-11-21T01:27:11.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108522024-11-21T01:27:11.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108532024-11-21T01:27:11.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108542024-11-21T01:27:11.658ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108552024-11-21T01:27:11.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108562024-11-21T01:27:11.660ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108572024-11-21T01:27:11.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
108582024-11-21T01:27:11.665ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108592024-11-21T01:27:11.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108602024-11-21T01:27:11.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
108612024-11-21T01:27:11.666ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a0843f1d-c01f-4f7d-90a2-9add3e694661", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108622024-11-21T01:27:11.666ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108632024-11-21T01:27:11.668ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108642024-11-21T01:27:11.668ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4168473e-a645-4a67-af35-4db54462058a", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108652024-11-21T01:27:11.668ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108662024-11-21T01:27:11.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108672024-11-21T01:27:11.670ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1715df7f-a3fc-49ce-b0cb-1d73f3bd77e6", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108682024-11-21T01:27:11.670ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108692024-11-21T01:27:11.670ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108702024-11-21T01:27:11.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108712024-11-21T01:27:11.672ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108722024-11-21T01:27:11.672ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 368.101088ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
108732024-11-21T01:27:11.672ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108742024-11-21T01:27:11.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108752024-11-21T01:27:11.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108762024-11-21T01:27:11.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108772024-11-21T01:27:11.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108782024-11-21T01:27:11.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108792024-11-21T01:27:11.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108802024-11-21T01:27:11.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108812024-11-21T01:27:11.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108822024-11-21T01:27:11.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108832024-11-21T01:27:11.678ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108842024-11-21T01:27:11.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108852024-11-21T01:27:11.680ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108862024-11-21T01:27:11.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108872024-11-21T01:27:11.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108882024-11-21T01:27:11.696ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108892024-11-21T01:27:11.696ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108902024-11-21T01:27:11.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108912024-11-21T01:27:11.699ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
108922024-11-21T01:27:11.699ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108932024-11-21T01:27:11.703ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 475cf7bc-78b5-49fa-afcf-1b1ea0d08443 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
108942024-11-21T01:27:11.703ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
108952024-11-21T01:27:11.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
108962024-11-21T01:27:11.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108972024-11-21T01:27:11.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
108982024-11-21T01:27:11.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108992024-11-21T01:27:11.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109002024-11-21T01:27:11.709ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 405.561065ms iteration = 21 status = 0
109012024-11-21T01:27:11.710ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(ed4e3252-0a22-4eb1-879f-b3666090902e, 0), (0cb61ac4-a930-47cd-acd0-7c378ecac5f8, 0), (54a1b330-10e6-4410-b67b-248cae3d8173, 0)]
109022024-11-21T01:27:11.710ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1610, tv_nsec: 607605571 } })
109032024-11-21T01:27:11.717ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109042024-11-21T01:27:11.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109052024-11-21T01:27:11.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109062024-11-21T01:27:11.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109072024-11-21T01:27:11.722ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109082024-11-21T01:27:11.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109092024-11-21T01:27:11.722ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109102024-11-21T01:27:11.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109112024-11-21T01:27:11.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109122024-11-21T01:27:11.724ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
109132024-11-21T01:27:11.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109142024-11-21T01:27:11.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109152024-11-21T01:27:11.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109162024-11-21T01:27:11.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109172024-11-21T01:27:11.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109182024-11-21T01:27:11.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109192024-11-21T01:27:11.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109202024-11-21T01:27:11.733ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109212024-11-21T01:27:11.734ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae0e7bf9-4865-4ffd-a3f4-35e0454680e7", "content-length": "134", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109222024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
109232024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
109242024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109252024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109262024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109272024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109282024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109292024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109302024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109312024-11-21T01:27:11.734ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109322024-11-21T01:27:11.735ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
109332024-11-21T01:27:11.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109342024-11-21T01:27:11.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109352024-11-21T01:27:11.737ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 4d6538e9-2779-4ffe-b732-b8ef5b68fff3, kind: Service { id: 50ef7a5a-8210-43f1-a548-846251e25074 }, name: Name("external-dns-50ef7a5a-8210-43f1-a548-846251e25074"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 90d25e95-e0a0-4767-914f-6a42c8b1e264, kind: Service { id: 403cce04-ffba-4276-94a6-76cab9338e71 }, name: Name("external-dns-403cce04-ffba-4276-94a6-76cab9338e71"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 63031233-d4cf-486c-a883-b94591ef6215, kind: Service { id: bbffc4db-58c5-4210-973d-49d52a55513e }, name: Name("nexus-bbffc4db-58c5-4210-973d-49d52a55513e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6eb7eb-9f19-4410-8b07-657b90ce790a, kind: Service { id: 5382fba6-edea-49d2-8ecc-9b1edfc688be }, name: Name("nexus-5382fba6-edea-49d2-8ecc-9b1edfc688be"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 138])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e349c246-31d7-4a6d-8e38-cf8679bf8d63, kind: Service { id: 3285ddd9-4901-4d45-8459-dd50ba0635ef }, name: Name("nexus-3285ddd9-4901-4d45-8459-dd50ba0635ef"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
109362024-11-21T01:27:11.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109372024-11-21T01:27:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109382024-11-21T01:27:11.737ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109392024-11-21T01:27:11.737ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "44f967e5-5059-4c7d-8fec-ebb0424d2836", "content-length": "2", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109402024-11-21T01:27:11.737ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109412024-11-21T01:27:11.738ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "542c5d19-24e3-4373-8285-1b9e0f952edd", "content-length": "51", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109422024-11-21T01:27:11.738ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
109432024-11-21T01:27:11.738ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109442024-11-21T01:27:11.739ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109452024-11-21T01:27:11.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
109462024-11-21T01:27:11.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109472024-11-21T01:27:11.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109482024-11-21T01:27:11.742ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
109492024-11-21T01:27:11.742ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4d6538e9-2779-4ffe-b732-b8ef5b68fff3, kind: Service { id: 50ef7a5a-8210-43f1-a548-846251e25074 }, name: Name("external-dns-50ef7a5a-8210-43f1-a548-846251e25074"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 90d25e95-e0a0-4767-914f-6a42c8b1e264, kind: Service { id: 403cce04-ffba-4276-94a6-76cab9338e71 }, name: Name("external-dns-403cce04-ffba-4276-94a6-76cab9338e71"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 63031233-d4cf-486c-a883-b94591ef6215, kind: Service { id: bbffc4db-58c5-4210-973d-49d52a55513e }, name: Name("nexus-bbffc4db-58c5-4210-973d-49d52a55513e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 9])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ab6eb7eb-9f19-4410-8b07-657b90ce790a, kind: Service { id: 5382fba6-edea-49d2-8ecc-9b1edfc688be }, name: Name("nexus-5382fba6-edea-49d2-8ecc-9b1edfc688be"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 187, 138])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e349c246-31d7-4a6d-8e38-cf8679bf8d63, kind: Service { id: 3285ddd9-4901-4d45-8459-dd50ba0635ef }, name: Name("nexus-3285ddd9-4901-4d45-8459-dd50ba0635ef"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
109502024-11-21T01:27:11.742ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
109512024-11-21T01:27:11.742ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c64a3854-cad1-4d17-adb2-3f6f4e743c5a", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109522024-11-21T01:27:11.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109532024-11-21T01:27:11.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109542024-11-21T01:27:11.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109552024-11-21T01:27:11.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109562024-11-21T01:27:11.747ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
109572024-11-21T01:27:11.747ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
109582024-11-21T01:27:11.747ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
109592024-11-21T01:27:11.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109602024-11-21T01:27:11.747ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ffee33a-4cca-4c4d-8cee-edbbc7022272", "content-length": "476", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109612024-11-21T01:27:11.747ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
109622024-11-21T01:27:11.748ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "54d9ba60-fdd8-4e63-9281-54bfdb38ceb5", "content-length": "734", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109632024-11-21T01:27:11.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109642024-11-21T01:27:11.748ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
109652024-11-21T01:27:11.748ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "623cd240-51b9-482f-9e14-c0cddae80562", "content-length": "111", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109662024-11-21T01:27:11.748ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
109672024-11-21T01:27:11.748ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d87f0e1b-c021-4d5e-9a5e-aa0aa4330a21", "content-length": "111", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109682024-11-21T01:27:11.748ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
109692024-11-21T01:27:11.749ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d0e2c57-39ad-4bae-b651-3f5f87eed014", "content-length": "167", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109702024-11-21T01:27:11.749ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
109712024-11-21T01:27:11.749ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b3c8d12-9f99-4d05-8bfb-5decbc5c5120", "content-length": "167", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109722024-11-21T01:27:11.749ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
109732024-11-21T01:27:11.749ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0522300c-3219-4a19-806c-4d1a8f53b6c7", "content-length": "175", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109742024-11-21T01:27:11.749ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
109752024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "43e873b4-b935-4e93-a148-1263a282ed94", "content-length": "175", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109762024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
109772024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "40fd5f02-5853-418f-9e0f-a675064632db", "content-length": "702", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109782024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
109792024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e5514dd-dc2c-43a4-9562-a8405af74b97", "content-length": "727", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109802024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
109812024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6411e33f-6733-4ff3-ad6a-39556e58ebc6", "content-length": "729", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109822024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
109832024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a920a8f1-207c-4f79-9aef-14e4a7f63b82", "content-length": "728", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109842024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
109852024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c9812ab-54da-490f-b680-bdb2ed9ac2e2", "content-length": "722", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109862024-11-21T01:27:11.750ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
109872024-11-21T01:27:11.751ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f619e176-6e6d-4246-a7e0-c15705bf79f1", "content-length": "109", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109882024-11-21T01:27:11.751ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
109892024-11-21T01:27:11.751ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4184016-28b8-4d6b-9c14-aa9028bb1ce5", "content-length": "109", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109902024-11-21T01:27:11.751ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
109912024-11-21T01:27:11.751ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c858ab52-1918-408b-8a98-96b35c80b2cb", "content-length": "169", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109922024-11-21T01:27:11.751ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
109932024-11-21T01:27:11.751ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109942024-11-21T01:27:11.751ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109952024-11-21T01:27:11.752ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "12d85ebe-3c51-4942-abbb-9d35130953e3", "content-length": "169", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109962024-11-21T01:27:11.752ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
109972024-11-21T01:27:11.752ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fca21f0e-7af4-4e74-9508-4c3ae81ea2a3", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
109982024-11-21T01:27:11.753ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 449.299412ms iteration = 21 status = {}
109992024-11-21T01:27:11.753ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb1e76f8-052c-442c-94e1-ea0c1ced6ab3", "content-length": "178", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110002024-11-21T01:27:11.753ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
110012024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aca56431-4c5e-43eb-a9c6-574d1433cf70", "content-length": "178", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110022024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
110032024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d960d21f-9ee8-43c2-a536-0d885e9bbbef", "content-length": "702", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110042024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
110052024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca44f8a5-0517-4976-ab5d-b5b430d4b75f", "content-length": "727", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110062024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
110072024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "059a4285-dec7-4e1b-914c-aed0074bdfa9", "content-length": "729", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110082024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
110092024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f60db1a-eeb0-4c64-93ec-e93f3aefeaef", "content-length": "728", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110102024-11-21T01:27:11.754ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110112024-11-21T01:27:11.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110122024-11-21T01:27:11.756ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110132024-11-21T01:27:11.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
110142024-11-21T01:27:11.758ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110152024-11-21T01:27:11.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110162024-11-21T01:27:11.764ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110172024-11-21T01:27:11.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
110182024-11-21T01:27:11.765ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110192024-11-21T01:27:11.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110202024-11-21T01:27:11.789ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110212024-11-21T01:27:11.793ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "137f8c06-7342-46d5-a9bc-53a7c72cc7ef", "content-length": "691", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110222024-11-21T01:27:11.793ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
110232024-11-21T01:27:11.793ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
110242024-11-21T01:27:11.793ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
110252024-11-21T01:27:11.794ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 490.247809ms iteration = 21 status = {}
110262024-11-21T01:27:11.854ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
110272024-11-21T01:27:11.854ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
110282024-11-21T01:27:11.854ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, time_created: 2024-11-21T01:17:13.128462Z, time_modified: 2024-11-21T01:17:13.128462Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
110292024-11-21T01:27:11.854ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
110302024-11-21T01:27:11.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110312024-11-21T01:27:11.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110322024-11-21T01:27:11.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110332024-11-21T01:27:11.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110342024-11-21T01:27:11.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110352024-11-21T01:27:11.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
110362024-11-21T01:27:11.893ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
110372024-11-21T01:27:11.894ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "86961892-03b9-4247-8bca-7937936e4f39", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110382024-11-21T01:27:11.895ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
110392024-11-21T01:27:11.895ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 591.11053ms
110402024-11-21T01:27:11.895ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 591.12042ms iteration = 3 status = {}
110412024-11-21T01:27:11.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "82dab271-aa92-4346-8620-f13006c5ebad", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110422024-11-21T01:27:11.929ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
110432024-11-21T01:27:11.929ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110442024-11-21T01:27:11.929ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "83594b6d-951f-46a1-acf5-baa4ef92a9f4", "content-length": "682", "date": "Thu, 21 Nov 2024 01:27:10 GMT"} })
110452024-11-21T01:27:11.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110462024-11-21T01:27:11.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110472024-11-21T01:27:11.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110482024-11-21T01:27:11.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110492024-11-21T01:27:11.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110502024-11-21T01:27:11.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110512024-11-21T01:27:11.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110522024-11-21T01:27:11.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110532024-11-21T01:27:11.949ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 645.496207ms iteration = 21 status = {}
110542024-11-21T01:27:12.135ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec714afb-3eda-4469-bb1f-05eb073ce623", "content-length": "30757", "date": "Thu, 21 Nov 2024 01:27:11 GMT"} })
110552024-11-21T01:27:12.137ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
110562024-11-21T01:27:12.137ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
110572024-11-21T01:27:12.137ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
110582024-11-21T01:27:12.139ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110592024-11-21T01:27:12.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110602024-11-21T01:27:12.141ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110612024-11-21T01:27:12.143ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110622024-11-21T01:27:12.143ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110632024-11-21T01:27:12.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110642024-11-21T01:27:12.317ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 155e48c1-bf85-4662-9c8e-3ade235d514f file = nexus/db-queries/src/db/datastore/inventory.rs:1000
110652024-11-21T01:27:12.317ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 155e48c1-bf85-4662-9c8e-3ade235d514f time_started = 2024-11-21 01:27:11.747386 UTC
110662024-11-21T01:27:12.317ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.013428461s iteration = 3 status = {"collection_id":"155e48c1-bf85-4662-9c8e-3ade235d514f","time_done":"2024-11-21 01:27:12.137811 UTC","time_started":"2024-11-21 01:27:11.747386 UTC"}
110672024-11-21T01:27:12.317ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
110682024-11-21T01:27:12.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110692024-11-21T01:27:12.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110702024-11-21T01:27:12.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110712024-11-21T01:27:12.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110722024-11-21T01:27:12.321ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110732024-11-21T01:27:12.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110742024-11-21T01:27:12.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110752024-11-21T01:27:12.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110762024-11-21T01:27:12.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110772024-11-21T01:27:12.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110782024-11-21T01:27:12.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110792024-11-21T01:27:12.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110802024-11-21T01:27:12.373ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 56.227572ms iteration = 24 status = {"physical_disks_added":0}
110812024-11-21T01:27:12.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6fab462-bab0-4d34-80bb-3cd5b378ef03 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110822024-11-21T01:27:12.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6fab462-bab0-4d34-80bb-3cd5b378ef03 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110832024-11-21T01:27:12.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a6fab462-bab0-4d34-80bb-3cd5b378ef03 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110842024-11-21T01:27:13.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 27ad6898-e136-4123-863e-5f3f0c927f09 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110852024-11-21T01:27:13.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 27ad6898-e136-4123-863e-5f3f0c927f09 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110862024-11-21T01:27:13.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 27ad6898-e136-4123-863e-5f3f0c927f09 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110872024-11-21T01:27:14.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eb6a6ec3-b700-4a35-94bd-f3194c9173ff roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110882024-11-21T01:27:14.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eb6a6ec3-b700-4a35-94bd-f3194c9173ff resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110892024-11-21T01:27:14.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = eb6a6ec3-b700-4a35-94bd-f3194c9173ff response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110902024-11-21T01:27:15.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2fd891e3-b024-48d2-afcb-e0da57aee24e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110912024-11-21T01:27:15.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2fd891e3-b024-48d2-afcb-e0da57aee24e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110922024-11-21T01:27:15.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2fd891e3-b024-48d2-afcb-e0da57aee24e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110932024-11-21T01:27:16.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ee39e9c5-c3b4-4d12-a944-043c5bf4669c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110942024-11-21T01:27:16.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ee39e9c5-c3b4-4d12-a944-043c5bf4669c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110952024-11-21T01:27:16.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ee39e9c5-c3b4-4d12-a944-043c5bf4669c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110962024-11-21T01:27:17.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0681e5ca-5799-4572-806e-f16f70650425 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110972024-11-21T01:27:17.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0681e5ca-5799-4572-806e-f16f70650425 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110982024-11-21T01:27:17.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0681e5ca-5799-4572-806e-f16f70650425 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
110992024-11-21T01:27:18.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = a049d12c-c150-4ad7-a334-1c4b888fa4e3 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
111002024-11-21T01:27:18.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = acd07317-551e-4260-b5c1-5df9ab5017ff roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111012024-11-21T01:27:18.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = acd07317-551e-4260-b5c1-5df9ab5017ff resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111022024-11-21T01:27:18.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = acd07317-551e-4260-b5c1-5df9ab5017ff response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111032024-11-21T01:27:19.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 10531d63-834a-4b5f-8e53-7a813b43de34 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111042024-11-21T01:27:19.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 10531d63-834a-4b5f-8e53-7a813b43de34 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111052024-11-21T01:27:19.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 10531d63-834a-4b5f-8e53-7a813b43de34 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111062024-11-21T01:27:20.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1e996407-416e-43af-b634-57dd823bf0fb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111072024-11-21T01:27:20.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1e996407-416e-43af-b634-57dd823bf0fb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111082024-11-21T01:27:20.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1e996407-416e-43af-b634-57dd823bf0fb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111092024-11-21T01:27:21.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
111102024-11-21T01:27:21.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111112024-11-21T01:27:21.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111122024-11-21T01:27:21.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
111132024-11-21T01:27:21.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111142024-11-21T01:27:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111152024-11-21T01:27:21.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111162024-11-21T01:27:21.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111172024-11-21T01:27:21.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111182024-11-21T01:27:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111192024-11-21T01:27:21.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111202024-11-21T01:27:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111212024-11-21T01:27:21.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111222024-11-21T01:27:21.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111232024-11-21T01:27:21.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111242024-11-21T01:27:21.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
111252024-11-21T01:27:21.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111262024-11-21T01:27:21.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111272024-11-21T01:27:21.325ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
111282024-11-21T01:27:21.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.62957ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
111292024-11-21T01:27:21.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.953031ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111302024-11-21T01:27:21.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 48c4740d-9b87-43f3-a346-a5d2666b32d0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111312024-11-21T01:27:21.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 48c4740d-9b87-43f3-a346-a5d2666b32d0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111322024-11-21T01:27:21.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 48c4740d-9b87-43f3-a346-a5d2666b32d0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111332024-11-21T01:27:22.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d3cbde5-66ef-4d6e-8d3c-2358656ee6c1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111342024-11-21T01:27:22.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d3cbde5-66ef-4d6e-8d3c-2358656ee6c1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111352024-11-21T01:27:22.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d3cbde5-66ef-4d6e-8d3c-2358656ee6c1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111362024-11-21T01:27:23.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = cc4ee3db-c457-4f2d-8ee2-66495e07132f roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
111372024-11-21T01:27:23.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = cc4ee3db-c457-4f2d-8ee2-66495e07132f resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
111382024-11-21T01:27:23.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = cc4ee3db-c457-4f2d-8ee2-66495e07132f response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?sort_by=id_ascending
111392024-11-21T01:27:23.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 0b604935-4398-4832-8584-000feeccd55b roles = RoleSet { roles: {} } uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
111402024-11-21T01:27:23.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 0b604935-4398-4832-8584-000feeccd55b resource = Database result = Ok(()) uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
111412024-11-21T01:27:23.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49606 req_id = 0b604935-4398-4832-8584-000feeccd55b response_code = 200 uri = /metrics/collectors/49435a09-4a28-49d2-bf6d-81a21cb92fe2/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNWYxNThiOC1mY2JlLTRmMzItODE1Mi03ZmYxNTU3MTBkZmQifX0%3D
111422024-11-21T01:27:23.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e312c9c-e974-427b-ab48-4e99bd2ed7c7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111432024-11-21T01:27:23.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e312c9c-e974-427b-ab48-4e99bd2ed7c7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111442024-11-21T01:27:23.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4e312c9c-e974-427b-ab48-4e99bd2ed7c7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111452024-11-21T01:27:24.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dbe27ecf-597a-4a72-a088-8bdc5d16b2ab roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111462024-11-21T01:27:24.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dbe27ecf-597a-4a72-a088-8bdc5d16b2ab resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111472024-11-21T01:27:24.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dbe27ecf-597a-4a72-a088-8bdc5d16b2ab response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111482024-11-21T01:27:25.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 121c7f32-113b-4cb1-8ad8-8041eb125923 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111492024-11-21T01:27:25.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 121c7f32-113b-4cb1-8ad8-8041eb125923 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111502024-11-21T01:27:25.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 121c7f32-113b-4cb1-8ad8-8041eb125923 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111512024-11-21T01:27:26.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a72f38b7-e786-4ea7-9bfb-eb4b69127d88 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111522024-11-21T01:27:26.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a72f38b7-e786-4ea7-9bfb-eb4b69127d88 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111532024-11-21T01:27:26.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a72f38b7-e786-4ea7-9bfb-eb4b69127d88 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111542024-11-21T01:27:27.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94f0e431-b2f3-4669-aa44-b54ded4b38f1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111552024-11-21T01:27:27.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94f0e431-b2f3-4669-aa44-b54ded4b38f1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111562024-11-21T01:27:27.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 94f0e431-b2f3-4669-aa44-b54ded4b38f1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111572024-11-21T01:27:28.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f7d0ccf-1db9-48cb-b6e7-30753fb46fed roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111582024-11-21T01:27:28.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f7d0ccf-1db9-48cb-b6e7-30753fb46fed resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111592024-11-21T01:27:28.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3f7d0ccf-1db9-48cb-b6e7-30753fb46fed response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111602024-11-21T01:27:29.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 890fa65d-c453-4fe2-b715-59772b6a85a2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111612024-11-21T01:27:29.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 890fa65d-c453-4fe2-b715-59772b6a85a2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111622024-11-21T01:27:29.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 890fa65d-c453-4fe2-b715-59772b6a85a2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111632024-11-21T01:27:30.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 70f95a6a-3339-4a3e-b1af-9c61b46630ce roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111642024-11-21T01:27:30.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 70f95a6a-3339-4a3e-b1af-9c61b46630ce resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111652024-11-21T01:27:30.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 70f95a6a-3339-4a3e-b1af-9c61b46630ce response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111662024-11-21T01:27:31.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
111672024-11-21T01:27:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111682024-11-21T01:27:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111692024-11-21T01:27:31.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
111702024-11-21T01:27:31.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111712024-11-21T01:27:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111722024-11-21T01:27:31.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111732024-11-21T01:27:31.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111742024-11-21T01:27:31.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111752024-11-21T01:27:31.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.453958ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111762024-11-21T01:27:31.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111772024-11-21T01:27:31.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111782024-11-21T01:27:31.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111792024-11-21T01:27:31.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111802024-11-21T01:27:31.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111812024-11-21T01:27:31.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111822024-11-21T01:27:31.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
111832024-11-21T01:27:31.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111842024-11-21T01:27:31.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111852024-11-21T01:27:31.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
111862024-11-21T01:27:31.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.422518ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
111872024-11-21T01:27:31.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c197805-4cea-4d3e-bac7-796d37a2e6c0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111882024-11-21T01:27:31.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c197805-4cea-4d3e-bac7-796d37a2e6c0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111892024-11-21T01:27:31.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3c197805-4cea-4d3e-bac7-796d37a2e6c0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111902024-11-21T01:27:32.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2b121acc-a704-4682-a0c5-6e6819fc421f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111912024-11-21T01:27:32.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2b121acc-a704-4682-a0c5-6e6819fc421f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111922024-11-21T01:27:32.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2b121acc-a704-4682-a0c5-6e6819fc421f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111932024-11-21T01:27:33.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 833 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 12354012-37ac-4c1d-9cbc-b83b2f839aba response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
111942024-11-21T01:27:34.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19626b7f-b493-47e3-919f-730ef7639df9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111952024-11-21T01:27:34.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19626b7f-b493-47e3-919f-730ef7639df9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111962024-11-21T01:27:34.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 19626b7f-b493-47e3-919f-730ef7639df9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111972024-11-21T01:27:35.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6eca8d42-5eb5-4086-aa13-cb628e38b707 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111982024-11-21T01:27:35.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6eca8d42-5eb5-4086-aa13-cb628e38b707 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
111992024-11-21T01:27:35.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6eca8d42-5eb5-4086-aa13-cb628e38b707 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112002024-11-21T01:27:36.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac818479-1255-4eb0-b668-53bdbf882b72 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112012024-11-21T01:27:36.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac818479-1255-4eb0-b668-53bdbf882b72 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112022024-11-21T01:27:36.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac818479-1255-4eb0-b668-53bdbf882b72 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112032024-11-21T01:27:37.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fb4b759-38a0-4a32-8b10-b4c968352346 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112042024-11-21T01:27:37.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fb4b759-38a0-4a32-8b10-b4c968352346 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112052024-11-21T01:27:37.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7fb4b759-38a0-4a32-8b10-b4c968352346 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112062024-11-21T01:27:38.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bdb44eca-cc03-45d3-b4bc-fb3b2cb5cf17 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112072024-11-21T01:27:38.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bdb44eca-cc03-45d3-b4bc-fb3b2cb5cf17 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112082024-11-21T01:27:38.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bdb44eca-cc03-45d3-b4bc-fb3b2cb5cf17 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112092024-11-21T01:27:39.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc480a7c-5860-451e-9e39-c7d8e979ce03 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112102024-11-21T01:27:39.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc480a7c-5860-451e-9e39-c7d8e979ce03 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112112024-11-21T01:27:39.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc480a7c-5860-451e-9e39-c7d8e979ce03 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112122024-11-21T01:27:40.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e8a7cc0-90df-4aa2-be68-d2e725cdd1e2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112132024-11-21T01:27:40.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e8a7cc0-90df-4aa2-be68-d2e725cdd1e2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112142024-11-21T01:27:40.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 6e8a7cc0-90df-4aa2-be68-d2e725cdd1e2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112152024-11-21T01:27:41.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 706096b6-eee1-416f-aa75-051a2ede3afb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112162024-11-21T01:27:41.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 706096b6-eee1-416f-aa75-051a2ede3afb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112172024-11-21T01:27:41.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 706096b6-eee1-416f-aa75-051a2ede3afb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
112182024-11-21T01:27:41.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = ab0046ad-c77b-4b16-a618-8e03128362d0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
112192024-11-21T01:27:41.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = ab0046ad-c77b-4b16-a618-8e03128362d0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
112202024-11-21T01:27:41.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = ab0046ad-c77b-4b16-a618-8e03128362d0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
112212024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
112222024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
112232024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
112242024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112252024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
112262024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112272024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
112282024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
112292024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112302024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
112312024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112322024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112332024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
112342024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
112352024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112362024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
112372024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112382024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
112392024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112402024-11-21T01:27:41.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112412024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112422024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112432024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112442024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112452024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112462024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
112472024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112482024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
112492024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
112502024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112512024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
112522024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112532024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
112542024-11-21T01:27:41.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
112552024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112562024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112572024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112582024-11-21T01:27:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112592024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112602024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
112612024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112622024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
112632024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
112642024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
112652024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
112662024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
112672024-11-21T01:27:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112682024-11-21T01:27:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112692024-11-21T01:27:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
112702024-11-21T01:27:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112712024-11-21T01:27:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
112722024-11-21T01:27:41.306ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1640, tv_nsec: 203377175 } })
112732024-11-21T01:27:41.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112742024-11-21T01:27:41.306ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
112752024-11-21T01:27:41.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112762024-11-21T01:27:41.307ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.58023ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
112772024-11-21T01:27:41.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112782024-11-21T01:27:41.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1640, tv_nsec: 204719494 } })
112792024-11-21T01:27:41.308ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
112802024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112812024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112822024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
112832024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112842024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112852024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
112862024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112872024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112882024-11-21T01:27:41.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112892024-11-21T01:27:41.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112902024-11-21T01:27:41.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112912024-11-21T01:27:41.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112922024-11-21T01:27:41.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112932024-11-21T01:27:41.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112942024-11-21T01:27:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112952024-11-21T01:27:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
112962024-11-21T01:27:41.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112972024-11-21T01:27:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112982024-11-21T01:27:41.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112992024-11-21T01:27:41.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113002024-11-21T01:27:41.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113012024-11-21T01:27:41.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113022024-11-21T01:27:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113032024-11-21T01:27:41.323ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113042024-11-21T01:27:41.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113052024-11-21T01:27:41.324ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.077029ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
113062024-11-21T01:27:41.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113072024-11-21T01:27:41.325ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1640, tv_nsec: 221832625 } })
113082024-11-21T01:27:41.325ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
113092024-11-21T01:27:41.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113102024-11-21T01:27:41.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113112024-11-21T01:27:41.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113122024-11-21T01:27:41.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113132024-11-21T01:27:41.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113142024-11-21T01:27:41.333ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113152024-11-21T01:27:41.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113162024-11-21T01:27:41.335ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113172024-11-21T01:27:41.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113182024-11-21T01:27:41.352ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113192024-11-21T01:27:41.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113202024-11-21T01:27:41.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113212024-11-21T01:27:41.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113222024-11-21T01:27:41.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113232024-11-21T01:27:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113242024-11-21T01:27:41.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113252024-11-21T01:27:41.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113262024-11-21T01:27:41.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113272024-11-21T01:27:41.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113282024-11-21T01:27:41.357ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113292024-11-21T01:27:41.357ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
113302024-11-21T01:27:41.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113312024-11-21T01:27:41.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113322024-11-21T01:27:41.367ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113332024-11-21T01:27:41.367ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113342024-11-21T01:27:41.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113352024-11-21T01:27:41.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
113362024-11-21T01:27:41.368ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.714284ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
113372024-11-21T01:27:41.369ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 64.201885ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
113382024-11-21T01:27:41.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113392024-11-21T01:27:41.379ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
113402024-11-21T01:27:41.379ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113412024-11-21T01:27:41.379ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0625224f-da50-45ce-beaf-a4c65f152ac2", "content-length": "26", "date": "Thu, 21 Nov 2024 01:27:41 GMT"} })
113422024-11-21T01:27:41.379ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113432024-11-21T01:27:41.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
113442024-11-21T01:27:41.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113452024-11-21T01:27:41.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113462024-11-21T01:27:41.381ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
113472024-11-21T01:27:41.381ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.823833ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
113482024-11-21T01:27:41.381ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113492024-11-21T01:27:41.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113502024-11-21T01:27:41.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
113512024-11-21T01:27:41.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113522024-11-21T01:27:41.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113532024-11-21T01:27:41.392ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.71509ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
113542024-11-21T01:27:41.395ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.52528ms iteration = 22 status = 0
113552024-11-21T01:27:41.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.506645ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113562024-11-21T01:27:41.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113572024-11-21T01:27:41.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113582024-11-21T01:27:41.398ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113592024-11-21T01:27:41.398ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
113602024-11-21T01:27:41.398ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113612024-11-21T01:27:41.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113622024-11-21T01:27:41.399ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
113632024-11-21T01:27:41.399ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.894351ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
113642024-11-21T01:27:41.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113652024-11-21T01:27:41.401ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113662024-11-21T01:27:41.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113672024-11-21T01:27:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113682024-11-21T01:27:41.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113692024-11-21T01:27:41.405ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113702024-11-21T01:27:41.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113712024-11-21T01:27:41.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113722024-11-21T01:27:41.405ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113732024-11-21T01:27:41.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113742024-11-21T01:27:41.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.539238ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
113752024-11-21T01:27:41.439ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113762024-11-21T01:27:41.439ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113772024-11-21T01:27:41.439ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.781829ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113782024-11-21T01:27:41.445ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.687427ms iteration = 25 status = {"physical_disks_added":0}
113792024-11-21T01:27:41.451ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
113802024-11-21T01:27:41.452ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113812024-11-21T01:27:41.452ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0049b972-d5e8-4bc8-b049-579b2c56d2b9", "content-length": "26", "date": "Thu, 21 Nov 2024 01:27:41 GMT"} })
113822024-11-21T01:27:41.452ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113832024-11-21T01:27:41.453ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113842024-11-21T01:27:41.486ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
113852024-11-21T01:27:41.486ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7a221f9-bd17-4563-b2ed-18c037150e0a", "content-length": "1", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
113862024-11-21T01:27:41.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113872024-11-21T01:27:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113882024-11-21T01:27:41.490ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
113892024-11-21T01:27:41.490ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113902024-11-21T01:27:41.490ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9494d4d2-5a89-4e56-9ba2-188c6bfdb7bf", "content-length": "26", "date": "Thu, 21 Nov 2024 01:27:41 GMT"} })
113912024-11-21T01:27:41.490ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113922024-11-21T01:27:41.492ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
113932024-11-21T01:27:41.502ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
113942024-11-21T01:27:41.502ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113952024-11-21T01:27:41.503ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 200.236522ms iteration = 22 status = null
113962024-11-21T01:27:41.518ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "41ae350a-f575-455a-8cad-bec551ebfffd", "content-length": "372", "date": "Thu, 21 Nov 2024 01:27:41 GMT"} })
113972024-11-21T01:27:41.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113982024-11-21T01:27:41.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113992024-11-21T01:27:41.533ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
114002024-11-21T01:27:41.533ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
114012024-11-21T01:27:41.533ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d9af176b-4584-4f93-b8f9-75b18dc68642", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
114022024-11-21T01:27:41.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114032024-11-21T01:27:41.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114042024-11-21T01:27:41.546ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 242.766991ms iteration = 22 status = {}
114052024-11-21T01:27:41.552ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
114062024-11-21T01:27:41.552ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6905ef40-645d-4bc9-90d5-2626c76f85de", "content-length": "691", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
114072024-11-21T01:27:41.553ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
114082024-11-21T01:27:41.553ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
114092024-11-21T01:27:41.553ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
114102024-11-21T01:27:41.553ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 250.399599ms iteration = 22 status = {}
114112024-11-21T01:27:41.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114122024-11-21T01:27:41.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114132024-11-21T01:27:41.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114142024-11-21T01:27:41.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114152024-11-21T01:27:41.560ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114162024-11-21T01:27:41.560ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114172024-11-21T01:27:41.560ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "41b7b38b-95ba-4971-9317-4c594fa931bc", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
114182024-11-21T01:27:41.562ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 258.28034ms iteration = 22 status = {}
114192024-11-21T01:27:41.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114202024-11-21T01:27:41.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114212024-11-21T01:27:41.618ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
114222024-11-21T01:27:41.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114232024-11-21T01:27:41.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114242024-11-21T01:27:41.628ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
114252024-11-21T01:27:41.628ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6581b9a3-72e6-48f6-a8ee-17fba891fa6d", "content-length": "134", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
114262024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
114272024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
114282024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
114292024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
114302024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114312024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114322024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114332024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114342024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114352024-11-21T01:27:41.628ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114362024-11-21T01:27:41.629ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
114372024-11-21T01:27:41.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114382024-11-21T01:27:41.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114392024-11-21T01:27:41.631ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
114402024-11-21T01:27:41.631ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3232552-5f25-4c44-ba92-5ae05eca4d1d", "content-length": "2", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
114412024-11-21T01:27:41.631ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
114422024-11-21T01:27:41.631ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "be740ba1-ffce-4900-9154-738dfdee1079", "content-length": "51", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
114432024-11-21T01:27:41.631ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
114442024-11-21T01:27:41.631ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
114452024-11-21T01:27:41.730ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0a896c03-da38-450f-a895-44d2a78f69ec", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
114462024-11-21T01:27:41.730ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
114472024-11-21T01:27:41.730ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
114482024-11-21T01:27:41.731ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "136c9e5c-1aba-4bd0-948b-0bc269fa5c0a", "content-length": "682", "date": "Thu, 21 Nov 2024 01:27:40 GMT"} })
114492024-11-21T01:27:41.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114502024-11-21T01:27:41.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114512024-11-21T01:27:41.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114522024-11-21T01:27:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114532024-11-21T01:27:41.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114542024-11-21T01:27:41.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114552024-11-21T01:27:41.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114562024-11-21T01:27:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114572024-11-21T01:27:41.748ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 445.047451ms iteration = 22 status = {}
114582024-11-21T01:27:42.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d1e6698-f33c-4983-9d35-dfe41b802376 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114592024-11-21T01:27:42.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d1e6698-f33c-4983-9d35-dfe41b802376 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114602024-11-21T01:27:42.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7d1e6698-f33c-4983-9d35-dfe41b802376 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114612024-11-21T01:27:43.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 62ee7632-83d3-414e-9fef-4143f7d0b756 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114622024-11-21T01:27:43.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 62ee7632-83d3-414e-9fef-4143f7d0b756 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114632024-11-21T01:27:43.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 62ee7632-83d3-414e-9fef-4143f7d0b756 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114642024-11-21T01:27:44.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cee5b611-8486-4f00-ab46-58a027350011 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114652024-11-21T01:27:44.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cee5b611-8486-4f00-ab46-58a027350011 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114662024-11-21T01:27:44.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cee5b611-8486-4f00-ab46-58a027350011 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114672024-11-21T01:27:45.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 398b226f-70a7-41ef-8821-2fdfc0a8d6ec roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114682024-11-21T01:27:45.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 398b226f-70a7-41ef-8821-2fdfc0a8d6ec resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114692024-11-21T01:27:45.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 398b226f-70a7-41ef-8821-2fdfc0a8d6ec response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114702024-11-21T01:27:46.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 773674d1-62a6-420b-ac34-2244953f265b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114712024-11-21T01:27:46.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 773674d1-62a6-420b-ac34-2244953f265b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114722024-11-21T01:27:46.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 773674d1-62a6-420b-ac34-2244953f265b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114732024-11-21T01:27:47.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb045fd4-91f4-4664-b2df-35ab3c897e0f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114742024-11-21T01:27:47.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb045fd4-91f4-4664-b2df-35ab3c897e0f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114752024-11-21T01:27:47.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = cb045fd4-91f4-4664-b2df-35ab3c897e0f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114762024-11-21T01:27:48.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d4a376b5-0226-41c6-b2cc-ef3ed6f2822a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114772024-11-21T01:27:48.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d4a376b5-0226-41c6-b2cc-ef3ed6f2822a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114782024-11-21T01:27:48.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d4a376b5-0226-41c6-b2cc-ef3ed6f2822a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114792024-11-21T01:27:48.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = f173ba2e-c77b-4d03-bb5a-4c76027dfdd0 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
114802024-11-21T01:27:49.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 141810f2-5a5c-4c0d-a04f-f1a88e8c463b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114812024-11-21T01:27:49.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 141810f2-5a5c-4c0d-a04f-f1a88e8c463b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114822024-11-21T01:27:49.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 141810f2-5a5c-4c0d-a04f-f1a88e8c463b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114832024-11-21T01:27:50.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5dca745a-9143-43c8-9551-77b44687b311 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114842024-11-21T01:27:50.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5dca745a-9143-43c8-9551-77b44687b311 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114852024-11-21T01:27:50.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5dca745a-9143-43c8-9551-77b44687b311 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
114862024-11-21T01:27:51.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
114872024-11-21T01:27:51.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114882024-11-21T01:27:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114892024-11-21T01:27:51.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
114902024-11-21T01:27:51.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114912024-11-21T01:27:51.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114922024-11-21T01:27:51.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114932024-11-21T01:27:51.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114942024-11-21T01:27:51.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114952024-11-21T01:27:51.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.321067ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114962024-11-21T01:27:51.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114972024-11-21T01:27:51.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114982024-11-21T01:27:51.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114992024-11-21T01:27:51.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115002024-11-21T01:27:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115012024-11-21T01:27:51.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115022024-11-21T01:27:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
115032024-11-21T01:27:51.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115042024-11-21T01:27:51.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115052024-11-21T01:27:51.321ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
115062024-11-21T01:27:51.321ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.037464ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
115072024-11-21T01:27:51.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f596abc8-d2fe-4346-b535-4ccf0f6d3135 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115082024-11-21T01:27:51.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f596abc8-d2fe-4346-b535-4ccf0f6d3135 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115092024-11-21T01:27:51.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f596abc8-d2fe-4346-b535-4ccf0f6d3135 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115102024-11-21T01:27:52.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9fe5e34d-9618-42b4-a2b4-14bf6dee3875 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115112024-11-21T01:27:52.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9fe5e34d-9618-42b4-a2b4-14bf6dee3875 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115122024-11-21T01:27:52.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9fe5e34d-9618-42b4-a2b4-14bf6dee3875 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115132024-11-21T01:27:53.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31a8a02f-e6cd-41fa-8cea-31ee14df7263 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115142024-11-21T01:27:53.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31a8a02f-e6cd-41fa-8cea-31ee14df7263 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115152024-11-21T01:27:53.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31a8a02f-e6cd-41fa-8cea-31ee14df7263 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115162024-11-21T01:27:54.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 70f3ecc7-921b-4cdb-a146-797f8c94d4ec roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115172024-11-21T01:27:54.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 70f3ecc7-921b-4cdb-a146-797f8c94d4ec resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115182024-11-21T01:27:54.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 70f3ecc7-921b-4cdb-a146-797f8c94d4ec response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115192024-11-21T01:27:55.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e440dc32-3e9a-4690-ac9f-a7c4cae08594 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115202024-11-21T01:27:55.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e440dc32-3e9a-4690-ac9f-a7c4cae08594 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115212024-11-21T01:27:55.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e440dc32-3e9a-4690-ac9f-a7c4cae08594 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115222024-11-21T01:27:56.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7279b754-e303-4ffc-a410-f1a79abbc9ab roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
115232024-11-21T01:27:56.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7279b754-e303-4ffc-a410-f1a79abbc9ab resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
115242024-11-21T01:27:56.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 7279b754-e303-4ffc-a410-f1a79abbc9ab response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
115252024-11-21T01:27:56.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 72b139c2-1976-410e-843c-ab5748debb33 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
115262024-11-21T01:27:56.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 72b139c2-1976-410e-843c-ab5748debb33 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
115272024-11-21T01:27:56.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 72b139c2-1976-410e-843c-ab5748debb33 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
115282024-11-21T01:27:56.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36855235-9133-44de-bf47-dd5a087f719a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115292024-11-21T01:27:56.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36855235-9133-44de-bf47-dd5a087f719a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115302024-11-21T01:27:56.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 36855235-9133-44de-bf47-dd5a087f719a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115312024-11-21T01:27:57.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a3d47d11-82f4-4d7c-824c-4e092954a768 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115322024-11-21T01:27:57.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a3d47d11-82f4-4d7c-824c-4e092954a768 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115332024-11-21T01:27:57.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a3d47d11-82f4-4d7c-824c-4e092954a768 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115342024-11-21T01:27:58.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c2d0fdf4-174f-4903-b3e9-72bc7ba985e9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115352024-11-21T01:27:58.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c2d0fdf4-174f-4903-b3e9-72bc7ba985e9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115362024-11-21T01:27:58.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c2d0fdf4-174f-4903-b3e9-72bc7ba985e9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115372024-11-21T01:27:59.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d38cb64-947a-47de-93ea-0a3a317eae5b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115382024-11-21T01:27:59.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d38cb64-947a-47de-93ea-0a3a317eae5b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115392024-11-21T01:27:59.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d38cb64-947a-47de-93ea-0a3a317eae5b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115402024-11-21T01:28:00.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f249fca-d2e2-4990-a4cb-6b0cf17259e2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115412024-11-21T01:28:00.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f249fca-d2e2-4990-a4cb-6b0cf17259e2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115422024-11-21T01:28:00.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9f249fca-d2e2-4990-a4cb-6b0cf17259e2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115432024-11-21T01:28:01.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
115442024-11-21T01:28:01.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115452024-11-21T01:28:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115462024-11-21T01:28:01.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
115472024-11-21T01:28:01.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115482024-11-21T01:28:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115492024-11-21T01:28:01.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115502024-11-21T01:28:01.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115512024-11-21T01:28:01.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115522024-11-21T01:28:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115532024-11-21T01:28:01.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115542024-11-21T01:28:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115552024-11-21T01:28:01.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115562024-11-21T01:28:01.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115572024-11-21T01:28:01.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115582024-11-21T01:28:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
115592024-11-21T01:28:01.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115602024-11-21T01:28:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115612024-11-21T01:28:01.322ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
115622024-11-21T01:28:01.322ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.836111ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
115632024-11-21T01:28:01.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.642456ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115642024-11-21T01:28:01.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4d4e7e25-a9a7-4ada-b2da-46ee3c6520c0 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115652024-11-21T01:28:01.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4d4e7e25-a9a7-4ada-b2da-46ee3c6520c0 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115662024-11-21T01:28:01.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 4d4e7e25-a9a7-4ada-b2da-46ee3c6520c0 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115672024-11-21T01:28:02.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 48a4cd1b-7e13-486d-b03e-6c2adf053ef8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115682024-11-21T01:28:02.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 48a4cd1b-7e13-486d-b03e-6c2adf053ef8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115692024-11-21T01:28:02.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 48a4cd1b-7e13-486d-b03e-6c2adf053ef8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115702024-11-21T01:28:03.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 695 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = f2f2dd2a-4bb3-467b-9db4-bdee39725339 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
115712024-11-21T01:28:03.522ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac7ad476-a3c1-4d7f-bc9f-eeb6b82b294b uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-21T01:28:03.502224265Z }
115722024-11-21T01:28:03.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac7ad476-a3c1-4d7f-bc9f-eeb6b82b294b roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
115732024-11-21T01:28:03.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac7ad476-a3c1-4d7f-bc9f-eeb6b82b294b resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
115742024-11-21T01:28:03.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38971 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ac7ad476-a3c1-4d7f-bc9f-eeb6b82b294b response_code = 204 uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
115752024-11-21T01:28:03.541ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 39455c4a-934f-4417-9d89-649513436f6b uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-21T01:28:03.541834644Z }
115762024-11-21T01:28:03.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 39455c4a-934f-4417-9d89-649513436f6b roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
115772024-11-21T01:28:03.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 39455c4a-934f-4417-9d89-649513436f6b resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
115782024-11-21T01:28:03.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38891 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 39455c4a-934f-4417-9d89-649513436f6b response_code = 204 uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
115792024-11-21T01:28:03.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 78868df1-7fbb-4a52-a0ef-bf6270253b1d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115802024-11-21T01:28:03.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 78868df1-7fbb-4a52-a0ef-bf6270253b1d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115812024-11-21T01:28:03.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 78868df1-7fbb-4a52-a0ef-bf6270253b1d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115822024-11-21T01:28:04.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e297a543-90ee-4ace-8310-397c255d06df roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115832024-11-21T01:28:04.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e297a543-90ee-4ace-8310-397c255d06df resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115842024-11-21T01:28:04.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = e297a543-90ee-4ace-8310-397c255d06df response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115852024-11-21T01:28:05.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2690ba31-8255-41b3-bbb3-57298dbdeda1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115862024-11-21T01:28:05.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2690ba31-8255-41b3-bbb3-57298dbdeda1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115872024-11-21T01:28:05.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2690ba31-8255-41b3-bbb3-57298dbdeda1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115882024-11-21T01:28:06.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2f9df82f-3247-48fc-9d9d-6694f456451e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115892024-11-21T01:28:06.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2f9df82f-3247-48fc-9d9d-6694f456451e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115902024-11-21T01:28:06.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2f9df82f-3247-48fc-9d9d-6694f456451e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115912024-11-21T01:28:07.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc5fc220-6e25-4ddc-a628-405b2565a60e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115922024-11-21T01:28:07.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc5fc220-6e25-4ddc-a628-405b2565a60e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115932024-11-21T01:28:07.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dc5fc220-6e25-4ddc-a628-405b2565a60e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115942024-11-21T01:28:08.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d51df18-4ab9-402a-8a15-193ed8d861e9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115952024-11-21T01:28:08.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d51df18-4ab9-402a-8a15-193ed8d861e9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115962024-11-21T01:28:08.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d51df18-4ab9-402a-8a15-193ed8d861e9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115972024-11-21T01:28:09.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1fd863a1-414b-437b-91cc-51737abbb863 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115982024-11-21T01:28:09.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1fd863a1-414b-437b-91cc-51737abbb863 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
115992024-11-21T01:28:09.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1fd863a1-414b-437b-91cc-51737abbb863 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
116002024-11-21T01:28:10.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5a0de51-0720-4bd8-ae8e-d0b28692d935 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
116012024-11-21T01:28:10.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5a0de51-0720-4bd8-ae8e-d0b28692d935 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
116022024-11-21T01:28:10.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b5a0de51-0720-4bd8-ae8e-d0b28692d935 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
116032024-11-21T01:28:11.303ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
116042024-11-21T01:28:11.303ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
116052024-11-21T01:28:11.303ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116062024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
116072024-11-21T01:28:11.304ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
116082024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
116092024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
116102024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116112024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
116122024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
116132024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116142024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116152024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
116162024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
116172024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
116182024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
116192024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
116202024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
116212024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
116222024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
116232024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
116242024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116252024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
116262024-11-21T01:28:11.304ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-21 01:18:11.304096829 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
116272024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
116282024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
116292024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116302024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
116312024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
116322024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
116332024-11-21T01:28:11.304ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074
116342024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
116352024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.04\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074"}
116362024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
116372024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
116382024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
116392024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
116402024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
116412024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116422024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
116432024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116442024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116452024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116462024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
116472024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
116482024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116492024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
116502024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
116512024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
116522024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
116532024-11-21T01:28:11.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
116542024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
116552024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
116562024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
116572024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116582024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116592024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116602024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
116612024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
116622024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116632024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
116642024-11-21T01:28:11.304ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("403cce04-ffba-4276-94a6-76cab9338e71.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("50ef7a5a-8210-43f1-a548-846251e25074.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 201296896 } })
116652024-11-21T01:28:11.304ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("533221a7-87dc-40d6-9631-d7e9df3a16d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7476d0b8-adad-4918-b915-aae213b01071.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d8d6968b-3abb-4e6f-bece-80f196f71583.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 201298716 } })
116662024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116672024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
116682024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116692024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116702024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
116712024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
116722024-11-21T01:28:11.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116732024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
116742024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.122796ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
116752024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
116762024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.040984ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
116772024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
116782024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
116792024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
116802024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
116812024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
116822024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116832024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
116842024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
116852024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
116862024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
116872024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
116882024-11-21T01:28:11.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116892024-11-21T01:28:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
116902024-11-21T01:28:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116912024-11-21T01:28:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
116922024-11-21T01:28:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
116932024-11-21T01:28:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
116942024-11-21T01:28:11.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
116952024-11-21T01:28:11.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116962024-11-21T01:28:11.306ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116972024-11-21T01:28:11.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116982024-11-21T01:28:11.308ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.763757ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
116992024-11-21T01:28:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
117002024-11-21T01:28:11.309ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
117012024-11-21T01:28:11.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
117022024-11-21T01:28:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117032024-11-21T01:28:11.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117042024-11-21T01:28:11.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117052024-11-21T01:28:11.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
117062024-11-21T01:28:11.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117072024-11-21T01:28:11.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117082024-11-21T01:28:11.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117092024-11-21T01:28:11.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
117102024-11-21T01:28:11.312ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-21 01:18:11.304096829 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
117112024-11-21T01:28:11.312ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.345487ms iteration = 12 status = {"expiration":"2024-11-21T01:18:11.304096829Z","pruned":[]}
117122024-11-21T01:28:11.313ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 209662004 } })
117132024-11-21T01:28:11.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117142024-11-21T01:28:11.313ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
117152024-11-21T01:28:11.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
117162024-11-21T01:28:11.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117172024-11-21T01:28:11.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117182024-11-21T01:28:11.314ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117192024-11-21T01:28:11.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
117202024-11-21T01:28:11.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117212024-11-21T01:28:11.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117222024-11-21T01:28:11.316ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 212903019 } })
117232024-11-21T01:28:11.316ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
117242024-11-21T01:28:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
117252024-11-21T01:28:11.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117262024-11-21T01:28:11.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117272024-11-21T01:28:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117282024-11-21T01:28:11.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117292024-11-21T01:28:11.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117302024-11-21T01:28:11.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117312024-11-21T01:28:11.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117322024-11-21T01:28:11.320ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117332024-11-21T01:28:11.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117342024-11-21T01:28:11.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117352024-11-21T01:28:11.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117362024-11-21T01:28:11.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117372024-11-21T01:28:11.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117382024-11-21T01:28:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117392024-11-21T01:28:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
117402024-11-21T01:28:11.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117412024-11-21T01:28:11.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117422024-11-21T01:28:11.324ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.049829ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
117432024-11-21T01:28:11.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117442024-11-21T01:28:11.327ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
117452024-11-21T01:28:11.327ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
117462024-11-21T01:28:11.327ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.386201ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
117472024-11-21T01:28:11.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117482024-11-21T01:28:11.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117492024-11-21T01:28:11.329ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1670, tv_nsec: 225713760 } })
117502024-11-21T01:28:11.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117512024-11-21T01:28:11.329ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
117522024-11-21T01:28:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117532024-11-21T01:28:11.329ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117542024-11-21T01:28:11.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117552024-11-21T01:28:11.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
117562024-11-21T01:28:11.339ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117572024-11-21T01:28:11.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117582024-11-21T01:28:11.342ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117592024-11-21T01:28:11.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117602024-11-21T01:28:11.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117612024-11-21T01:28:11.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
117622024-11-21T01:28:11.346ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117632024-11-21T01:28:11.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
117642024-11-21T01:28:11.348ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117652024-11-21T01:28:11.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117662024-11-21T01:28:11.348ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117672024-11-21T01:28:11.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117682024-11-21T01:28:11.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117692024-11-21T01:28:11.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117702024-11-21T01:28:11.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117712024-11-21T01:28:11.353ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117722024-11-21T01:28:11.353ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117732024-11-21T01:28:11.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117742024-11-21T01:28:11.356ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.640981ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117752024-11-21T01:28:11.359ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117762024-11-21T01:28:11.359ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
117772024-11-21T01:28:11.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117782024-11-21T01:28:11.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117792024-11-21T01:28:11.360ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117802024-11-21T01:28:11.360ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.035756ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
117812024-11-21T01:28:11.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117822024-11-21T01:28:11.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117832024-11-21T01:28:11.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117842024-11-21T01:28:11.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117852024-11-21T01:28:11.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117862024-11-21T01:28:11.367ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117872024-11-21T01:28:11.367ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
117882024-11-21T01:28:11.367ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117892024-11-21T01:28:11.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117902024-11-21T01:28:11.376ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117912024-11-21T01:28:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117922024-11-21T01:28:11.378ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.533802ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
117932024-11-21T01:28:11.380ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
117942024-11-21T01:28:11.380ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
117952024-11-21T01:28:11.380ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.238614ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
117962024-11-21T01:28:11.380ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117972024-11-21T01:28:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117982024-11-21T01:28:11.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.729701ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117992024-11-21T01:28:11.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118002024-11-21T01:28:11.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
118012024-11-21T01:28:11.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118022024-11-21T01:28:11.389ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
118032024-11-21T01:28:11.389ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
118042024-11-21T01:28:11.389ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
118052024-11-21T01:28:11.389ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118062024-11-21T01:28:11.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118072024-11-21T01:28:11.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118082024-11-21T01:28:11.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118092024-11-21T01:28:11.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118102024-11-21T01:28:11.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118112024-11-21T01:28:11.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
118122024-11-21T01:28:11.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118132024-11-21T01:28:11.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118142024-11-21T01:28:11.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
118152024-11-21T01:28:11.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
118162024-11-21T01:28:11.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118172024-11-21T01:28:11.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118182024-11-21T01:28:11.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118192024-11-21T01:28:11.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118202024-11-21T01:28:11.409ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118212024-11-21T01:28:11.409ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
118222024-11-21T01:28:11.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.103672ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
118232024-11-21T01:28:11.415ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
118242024-11-21T01:28:11.415ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
118252024-11-21T01:28:11.415ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
118262024-11-21T01:28:11.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118272024-11-21T01:28:11.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118282024-11-21T01:28:11.461ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.878724ms iteration = 26 status = {"physical_disks_added":0}
118292024-11-21T01:28:11.485ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
118302024-11-21T01:28:11.485ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118312024-11-21T01:28:11.485ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba0348bc-ef0a-4096-967e-20c507629f86", "content-length": "26", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
118322024-11-21T01:28:11.486ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118332024-11-21T01:28:11.487ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118342024-11-21T01:28:11.506ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
118352024-11-21T01:28:11.506ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118362024-11-21T01:28:11.507ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15b1aa6c-278e-4c3e-87de-144c44058f99", "content-length": "26", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
118372024-11-21T01:28:11.507ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118382024-11-21T01:28:11.509ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118392024-11-21T01:28:11.569ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
118402024-11-21T01:28:11.617ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/4929648b-7103-40a5-8a25-6d3cccfcb107/state
118412024-11-21T01:28:11.619ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
118422024-11-21T01:28:11.619ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/4929648b-7103-40a5-8a25-6d3cccfcb107/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "616c19b4-bd8f-4317-b13e-9f7ef182d0ba", "content-length": "130", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
118432024-11-21T01:28:11.619ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c sled_id = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-21T01:28:03.541834644Z }, migration_in: None, migration_out: None } vmm_id = 4929648b-7103-40a5-8a25-6d3cccfcb107
118442024-11-21T01:28:11.622ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 sled_id = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 vmm_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-21T01:28:03.541834644Z }
118452024-11-21T01:28:11.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c roles = RoleSet { roles: {} } sled_id = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 vmm_id = 4929648b-7103-40a5-8a25-6d3cccfcb107
118462024-11-21T01:28:11.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c resource = Database result = Ok(()) sled_id = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 vmm_id = 4929648b-7103-40a5-8a25-6d3cccfcb107
118472024-11-21T01:28:11.698ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
118482024-11-21T01:28:11.698ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118492024-11-21T01:28:11.698ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75ad0092-faff-41d2-ae72-a5befbb0eaa8", "content-length": "26", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
118502024-11-21T01:28:11.698ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118512024-11-21T01:28:11.700ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
118522024-11-21T01:28:11.744ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
118532024-11-21T01:28:11.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118542024-11-21T01:28:11.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118552024-11-21T01:28:11.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118562024-11-21T01:28:11.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118572024-11-21T01:28:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118582024-11-21T01:28:11.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118592024-11-21T01:28:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118602024-11-21T01:28:11.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
118612024-11-21T01:28:11.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118622024-11-21T01:28:11.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118632024-11-21T01:28:11.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118642024-11-21T01:28:11.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
118652024-11-21T01:28:11.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118662024-11-21T01:28:11.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118672024-11-21T01:28:11.765ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
118682024-11-21T01:28:11.765ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 461.126258ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
118692024-11-21T01:28:11.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 474.395095ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
118702024-11-21T01:28:11.781ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 475.468551ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
118712024-11-21T01:28:11.793ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
118722024-11-21T01:28:11.793ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 0 version = 2
118732024-11-21T01:28:11.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118742024-11-21T01:28:11.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118752024-11-21T01:28:11.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118762024-11-21T01:28:11.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
118772024-11-21T01:28:11.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118782024-11-21T01:28:11.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118792024-11-21T01:28:11.799ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
118802024-11-21T01:28:11.799ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
118812024-11-21T01:28:11.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118822024-11-21T01:28:11.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118832024-11-21T01:28:11.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118842024-11-21T01:28:11.800ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 93361da3-b274-48b3-a9e4-0e092b4d7fb8 dns_zone_name = oxide.test found_so_far = 1 version = 2
118852024-11-21T01:28:11.800ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
118862024-11-21T01:28:11.800ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-21 01:17:14.861026 UTC dns_group = external generation = 2
118872024-11-21T01:28:11.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 496.595428ms iteration = 12 status = {"generation":2}
118882024-11-21T01:28:11.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118892024-11-21T01:28:11.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
118902024-11-21T01:28:11.802ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118912024-11-21T01:28:11.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118922024-11-21T01:28:11.804ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 500.617615ms iteration = 23 status = 0
118932024-11-21T01:28:11.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118942024-11-21T01:28:11.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118952024-11-21T01:28:11.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118962024-11-21T01:28:11.806ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
118972024-11-21T01:28:11.806ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-21T01:17:07.813944Z, time_modified: 2024-11-21T01:17:07.813944Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, db_silo: Silo { identity: SiloIdentity { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-21T01:17:14.824034Z, time_modified: 2024-11-21T01:17:14.824034Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
118982024-11-21T01:28:11.807ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 502.853167ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]}},"default_endpoint":{"silo_id":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","tls_certs":["def41c27aa66d5010ed3cef24f215e0e7b1e5f8d13c1d77ac2525c4166ce2826"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
118992024-11-21T01:28:11.808ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 503.875521ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
119002024-11-21T01:28:11.808ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6caf824f-910c-47d2-a350-1fbfce7136e4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
119012024-11-21T01:28:11.808ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
119022024-11-21T01:28:11.808ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-21 01:17:13.843411 UTC dns_group = internal generation = 1
119032024-11-21T01:28:11.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 504.880274ms iteration = 12 status = {"generation":1}
119042024-11-21T01:28:11.813ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "642d0b51-dee4-45c4-8d79-9bf64567f1d6", "content-length": "810", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
119052024-11-21T01:28:11.813ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(8002347) }} sled = sock
119062024-11-21T01:28:11.813ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
119072024-11-21T01:28:11.813ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
119082024-11-21T01:28:11.816ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
119092024-11-21T01:28:11.816ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 512.207858ms iteration = 23 status = {}
119102024-11-21T01:28:11.841ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
119112024-11-21T01:28:11.841ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "361917ba-b8c8-4cd5-aa8a-cb5e84c2664d", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119122024-11-21T01:28:11.841ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119132024-11-21T01:28:11.843ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8f34e7ca-5728-4622-a29a-075e9b056d2f", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119142024-11-21T01:28:11.843ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119152024-11-21T01:28:11.844ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
119162024-11-21T01:28:11.844ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 540.565637ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
119172024-11-21T01:28:11.849ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
119182024-11-21T01:28:11.849ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 545.014421ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
119192024-11-21T01:28:11.869ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
119202024-11-21T01:28:11.869ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c6589d6-0b8b-470c-b2b7-d80430e5458b", "content-length": "1", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
119212024-11-21T01:28:11.871ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119222024-11-21T01:28:11.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119232024-11-21T01:28:11.873ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 569.446395ms iteration = 23 status = null
119242024-11-21T01:28:11.898ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 594.63054ms iteration = 23 status = {}
119252024-11-21T01:28:11.942ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
119262024-11-21T01:28:11.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "44d8b5b5-679e-4a03-819e-11ddfa4b294b", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119272024-11-21T01:28:11.942ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119282024-11-21T01:28:11.944ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
119292024-11-21T01:28:11.944ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119302024-11-21T01:28:11.944ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3c53793-cba9-4b54-ac16-6f96b8365fde", "content-length": "583", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
119312024-11-21T01:28:11.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119322024-11-21T01:28:11.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119332024-11-21T01:28:11.945ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8c61f429-2db1-4c41-8f4e-a49da236b0b4", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119342024-11-21T01:28:11.945ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119352024-11-21T01:28:11.947ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1c34c322-3cc8-4224-8f16-a07fb0b53502", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119362024-11-21T01:28:11.947ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119372024-11-21T01:28:11.949ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
119382024-11-21T01:28:11.949ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 645.565468ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
119392024-11-21T01:28:11.963ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
119402024-11-21T01:28:11.963ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
119412024-11-21T01:28:11.988ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {0e167e7c-11ac-4d18-8839-a13ad5adaaaf: {10.151.2.175: {5bbbba5e-242a-4f60-896b-b52cb3be20ad}, 10.151.2.176: {5bbbba5e-242a-4f60-896b-b52cb3be20ad}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
119422024-11-21T01:28:11.988ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
119432024-11-21T01:28:11.988ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e42d20ef-7f04-47e6-a103-6821060473d4", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
119442024-11-21T01:28:11.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119452024-11-21T01:28:11.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119462024-11-21T01:28:11.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119472024-11-21T01:28:11.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119482024-11-21T01:28:11.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119492024-11-21T01:28:11.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119502024-11-21T01:28:11.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119512024-11-21T01:28:11.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119522024-11-21T01:28:11.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119532024-11-21T01:28:11.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119542024-11-21T01:28:12.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119552024-11-21T01:28:12.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119562024-11-21T01:28:12.003ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119572024-11-21T01:28:12.003ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119582024-11-21T01:28:12.003ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119592024-11-21T01:28:12.004ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4266bbb5-8787-4049-918a-25aae3d100e8", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
119602024-11-21T01:28:12.005ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 701.410265ms iteration = 23 status = {}
119612024-11-21T01:28:12.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 60a7ee29-9c0c-4128-a849-f97270b90847 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
119622024-11-21T01:28:12.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 60a7ee29-9c0c-4128-a849-f97270b90847 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
119632024-11-21T01:28:12.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 60a7ee29-9c0c-4128-a849-f97270b90847 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
119642024-11-21T01:28:12.025ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
119652024-11-21T01:28:12.025ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:36220
119662024-11-21T01:28:12.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36220 req_id = fbfa475f-4090-4373-8b07-4b0c936b3c28 roles = RoleSet { roles: {} } uri = /metrics/producers
119672024-11-21T01:28:12.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36220 req_id = fbfa475f-4090-4373-8b07-4b0c936b3c28 resource = Database result = Ok(()) uri = /metrics/producers
119682024-11-21T01:28:12.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119692024-11-21T01:28:12.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119702024-11-21T01:28:12.040ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
119712024-11-21T01:28:12.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119722024-11-21T01:28:12.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119732024-11-21T01:28:12.049ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
119742024-11-21T01:28:12.049ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b174861d-2a95-476c-8910-03c1dea6be8c", "content-length": "134", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
119752024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
119762024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
119772024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
119782024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
119792024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119802024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119812024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119822024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119832024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119842024-11-21T01:28:12.049ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119852024-11-21T01:28:12.050ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
119862024-11-21T01:28:12.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119872024-11-21T01:28:12.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119882024-11-21T01:28:12.052ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
119892024-11-21T01:28:12.052ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f697d3d3-55a8-45d3-9adc-d5c7214a2472", "content-length": "2", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
119902024-11-21T01:28:12.052ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
119912024-11-21T01:28:12.052ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaf612bd-609a-4ca5-8266-db68514705a9", "content-length": "51", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
119922024-11-21T01:28:12.052ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
119932024-11-21T01:28:12.052ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119942024-11-21T01:28:12.062ZINFOnexus: assigned collector to new producer collector_id = 49435a09-4a28-49d2-bf6d-81a21cb92fe2 file = nexus/src/app/oximeter.rs:76 producer_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
119952024-11-21T01:28:12.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36637 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:36220 req_id = fbfa475f-4090-4373-8b07-4b0c936b3c28 response_code = 201 uri = /metrics/producers
119962024-11-21T01:28:12.062ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "fbfa475f-4090-4373-8b07-4b0c936b3c28", "content-length": "41", "date": "Thu, 21 Nov 2024 01:28:12 GMT"} })
119972024-11-21T01:28:12.064ZDEBGnexus (producer-registration-task): registered with nexus successfully
119982024-11-21T01:28:12.064ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
119992024-11-21T01:28:12.159ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1c0d16a7-6a30-462c-a153-01d8b145fc9b", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
120002024-11-21T01:28:12.159ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
120012024-11-21T01:28:12.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
120022024-11-21T01:28:12.159ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "33fc42c2-a0d8-4705-a137-d207432a5e72", "content-length": "682", "date": "Thu, 21 Nov 2024 01:28:11 GMT"} })
120032024-11-21T01:28:12.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120042024-11-21T01:28:12.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120052024-11-21T01:28:12.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120062024-11-21T01:28:12.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120072024-11-21T01:28:12.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120082024-11-21T01:28:12.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120092024-11-21T01:28:12.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120102024-11-21T01:28:12.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120112024-11-21T01:28:12.177ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 873.014643ms iteration = 23 status = {}
120122024-11-21T01:28:13.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 952db84b-9241-487a-9e42-1e24f760ab06 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120132024-11-21T01:28:13.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 952db84b-9241-487a-9e42-1e24f760ab06 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120142024-11-21T01:28:13.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 952db84b-9241-487a-9e42-1e24f760ab06 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120152024-11-21T01:28:13.560ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 09500d58-6522-4e95-a9cc-73c031d2d907 uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-21T01:28:13.560200492Z }
120162024-11-21T01:28:13.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 09500d58-6522-4e95-a9cc-73c031d2d907 roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120172024-11-21T01:28:13.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 09500d58-6522-4e95-a9cc-73c031d2d907 resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120182024-11-21T01:28:13.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 09500d58-6522-4e95-a9cc-73c031d2d907 response_code = 204 uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120192024-11-21T01:28:14.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bfd1900a-8d9e-4780-a2ae-6ca6128c14ae roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120202024-11-21T01:28:14.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bfd1900a-8d9e-4780-a2ae-6ca6128c14ae resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120212024-11-21T01:28:14.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bfd1900a-8d9e-4780-a2ae-6ca6128c14ae response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120222024-11-21T01:28:14.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = f8a42bbc-447c-4dad-a323-5376f6a7446c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
120232024-11-21T01:28:14.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = f8a42bbc-447c-4dad-a323-5376f6a7446c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
120242024-11-21T01:28:14.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = f8a42bbc-447c-4dad-a323-5376f6a7446c response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
120252024-11-21T01:28:14.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = f6d85a19-ab60-49d6-9c42-c4f5927cb46a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
120262024-11-21T01:28:14.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = f6d85a19-ab60-49d6-9c42-c4f5927cb46a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
120272024-11-21T01:28:14.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = f6d85a19-ab60-49d6-9c42-c4f5927cb46a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
120282024-11-21T01:28:15.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f80838ec-6001-4b06-a558-e86d58a8bdbf roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120292024-11-21T01:28:15.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f80838ec-6001-4b06-a558-e86d58a8bdbf resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120302024-11-21T01:28:15.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f80838ec-6001-4b06-a558-e86d58a8bdbf response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120312024-11-21T01:28:15.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 45a8e910-b44f-4168-adf5-fa7eba43b673 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
120322024-11-21T01:28:15.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 45a8e910-b44f-4168-adf5-fa7eba43b673 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
120332024-11-21T01:28:15.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 45a8e910-b44f-4168-adf5-fa7eba43b673 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
120342024-11-21T01:28:16.024ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-21T01:28:16.024254125Z }
120352024-11-21T01:28:16.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120362024-11-21T01:28:16.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120372024-11-21T01:28:16.069ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107 vmm_needs_update = true
120382024-11-21T01:28:16.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120392024-11-21T01:28:16.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120402024-11-21T01:28:16.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120412024-11-21T01:28:16.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120422024-11-21T01:28:16.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120432024-11-21T01:28:16.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120442024-11-21T01:28:16.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120452024-11-21T01:28:16.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120462024-11-21T01:28:16.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120472024-11-21T01:28:16.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120482024-11-21T01:28:16.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120492024-11-21T01:28:16.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120502024-11-21T01:28:16.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120512024-11-21T01:28:16.086ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, lookup_type: ById(6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6) }, key: 7bc3193e-0379-4a52-8db0-fc186320043f, lookup_type: ById(7bc3193e-0379-4a52-8db0-fc186320043f) }, key: 599adf06-e1ce-43d6-a3ad-60119136e26c, lookup_type: ById(599adf06-e1ce-43d6-a3ad-60119136e26c) } result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120522024-11-21T01:28:16.096ZINFOnexus (dropshot_internal): starting update saga for 599adf06-e1ce-43d6-a3ad-60119136e26c actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-21T01:28:16.024254125Z }
120532024-11-21T01:28:16.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71769 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d response_code = 204 uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120542024-11-21T01:28:16.096ZDEBGnexus (dropshot_internal): preparing instance-update saga for 599adf06-e1ce-43d6-a3ad-60119136e26c... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 67bb0907-3843-4d7e-bb41-3134f92b359d uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120552024-11-21T01:28:16.096ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1a33ddc7-ab15-435e-80af-2a14a2ac1de6 uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-21T01:28:16.024254125Z }
120562024-11-21T01:28:16.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1a33ddc7-ab15-435e-80af-2a14a2ac1de6 roles = RoleSet { roles: {} } uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120572024-11-21T01:28:16.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1a33ddc7-ab15-435e-80af-2a14a2ac1de6 resource = Database result = Ok(()) uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120582024-11-21T01:28:16.101ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update
120592024-11-21T01:28:16.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6164 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1a33ddc7-ab15-435e-80af-2a14a2ac1de6 response_code = 204 uri = /vmms/4929648b-7103-40a5-8a25-6d3cccfcb107
120602024-11-21T01:28:16.103ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"599adf06-e1ce-43d6-a3ad-60119136e26c","lookup_type":{"ById":"599adf06-e1ce-43d6-a3ad-60119136e26c"},"parent":{"key":"7bc3193e-0379-4a52-8db0-fc186320043f","lookup_type":{"ById":"7bc3193e-0379-4a52-8db0-fc186320043f"},"parent":{"key":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","lookup_type":{"ById":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
120612024-11-21T01:28:16.103ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update
120622024-11-21T01:28:16.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 30c8c514-2594-4e2e-adcf-8767e4803057 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120632024-11-21T01:28:16.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 30c8c514-2594-4e2e-adcf-8767e4803057 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120642024-11-21T01:28:16.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 30c8c514-2594-4e2e-adcf-8767e4803057 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
120652024-11-21T01:28:16.148ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update
120662024-11-21T01:28:16.148ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
120672024-11-21T01:28:16.148ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
120682024-11-21T01:28:16.148ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
120692024-11-21T01:28:16.156ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
120702024-11-21T01:28:16.156ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
120712024-11-21T01:28:16.162ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
120722024-11-21T01:28:16.162ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
120732024-11-21T01:28:16.169ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
120742024-11-21T01:28:16.169ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("270c85b2-4567-49d6-9260-d394698c85b5")) node_id = 0 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
120752024-11-21T01:28:16.174ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
120762024-11-21T01:28:16.174ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
120772024-11-21T01:28:16.191ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update
120782024-11-21T01:28:16.193ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120792024-11-21T01:28:16.193ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120802024-11-21T01:28:16.195ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120812024-11-21T01:28:16.195ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120822024-11-21T01:28:16.197ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120832024-11-21T01:28:16.197ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120842024-11-21T01:28:16.207ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120852024-11-21T01:28:16.207ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120862024-11-21T01:28:16.209ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120872024-11-21T01:28:16.209ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120882024-11-21T01:28:16.211ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120892024-11-21T01:28:16.211ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120902024-11-21T01:28:16.213ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120912024-11-21T01:28:16.216ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, lookup_type: ById(6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6) }, key: 7bc3193e-0379-4a52-8db0-fc186320043f, lookup_type: ById(7bc3193e-0379-4a52-8db0-fc186320043f) }, key: 599adf06-e1ce-43d6-a3ad-60119136e26c, lookup_type: ById(599adf06-e1ce-43d6-a3ad-60119136e26c) } result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120922024-11-21T01:28:16.216ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance updater_id = 270c85b2-4567-49d6-9260-d394698c85b5
120932024-11-21T01:28:16.216ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120942024-11-21T01:28:16.216ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120952024-11-21T01:28:16.235ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance updater_id = 270c85b2-4567-49d6-9260-d394698c85b5
120962024-11-21T01:28:16.235ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120972024-11-21T01:28:16.235ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance
120982024-11-21T01:28:16.240ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c locked_gen = Generation(Generation(2)) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = LockInstance updater_id = 270c85b2-4567-49d6-9260-d394698c85b5
120992024-11-21T01:28:16.240ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121002024-11-21T01:28:16.240ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("270c85b2-4567-49d6-9260-d394698c85b5")}) node_id = 1 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
121012024-11-21T01:28:16.246ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121022024-11-21T01:28:16.246ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
121032024-11-21T01:28:16.253ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121042024-11-21T01:28:16.253ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121052024-11-21T01:28:16.255ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121062024-11-21T01:28:16.255ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121072024-11-21T01:28:16.256ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121082024-11-21T01:28:16.256ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121092024-11-21T01:28:16.258ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121102024-11-21T01:28:16.261ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, lookup_type: ById(6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6) }, key: 7bc3193e-0379-4a52-8db0-fc186320043f, lookup_type: ById(7bc3193e-0379-4a52-8db0-fc186320043f) }, key: 599adf06-e1ce-43d6-a3ad-60119136e26c, lookup_type: ById(599adf06-e1ce-43d6-a3ad-60119136e26c) } result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121112024-11-21T01:28:16.261ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121122024-11-21T01:28:16.261ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
121132024-11-21T01:28:16.274ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 4929648b-7103-40a5-8a25-6d3cccfcb107, time_created: 2024-11-21T01:27:55.245567Z, time_deleted: None, instance_id: 599adf06-e1ce-43d6-a3ad-60119136e26c, sled_id: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-21T01:28:16.024254Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-21T01:27:53.117747Z, gen: Generation(Generation(3)), propolis_id: Some(4929648b-7103-40a5-8a25-6d3cccfcb107), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(4929648b-7103-40a5-8a25-6d3cccfcb107 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-21T01:28:16.274485821Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
121142024-11-21T01:28:16.281ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121152024-11-21T01:28:16.281ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"599adf06-e1ce-43d6-a3ad-60119136e26c","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"4929648b-7103-40a5-8a25-6d3cccfcb107"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"599adf06-e1ce-43d6-a3ad-60119136e26c","lookup_type":{"ById":"599adf06-e1ce-43d6-a3ad-60119136e26c"},"parent":{"key":"7bc3193e-0379-4a52-8db0-fc186320043f","lookup_type":{"ById":"7bc3193e-0379-4a52-8db0-fc186320043f"},"parent":{"key":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6","lookup_type":{"ById":"6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"270c85b2-4567-49d6-9260-d394698c85b5"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"7bc3193e-0379-4a52-8db0-fc186320043f","ram_diff":1073741824},"destroy_active_vmm":"4929648b-7103-40a5-8a25-6d3cccfcb107","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-21T01:28:16.274485821Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121162024-11-21T01:28:16.281ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121172024-11-21T01:28:16.327ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121182024-11-21T01:28:16.327ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121192024-11-21T01:28:16.327ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121202024-11-21T01:28:16.327ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121212024-11-21T01:28:16.332ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121222024-11-21T01:28:16.332ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121232024-11-21T01:28:16.336ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121242024-11-21T01:28:16.337ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121252024-11-21T01:28:16.341ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121262024-11-21T01:28:16.341ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d4a515c0-3868-4ed3-a8d1-6c58fbc0312b")) node_id = 0 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121272024-11-21T01:28:16.346ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121282024-11-21T01:28:16.346ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121292024-11-21T01:28:16.355ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c parent_lock = UpdaterLock { updater_id: 270c85b2-4567-49d6-9260-d394698c85b5, locked_gen: Generation(Generation(2)) } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121302024-11-21T01:28:16.355ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = BecomeUpdater
121312024-11-21T01:28:16.355ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = BecomeUpdater
121322024-11-21T01:28:16.375ZDEBGnexus (SagaExecutor): inherited lock from 270c85b2-4567-49d6-9260-d394698c85b5 to d4a515c0-3868-4ed3-a8d1-6c58fbc0312b actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 270c85b2-4567-49d6-9260-d394698c85b5 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = BecomeUpdater updater_id = d4a515c0-3868-4ed3-a8d1-6c58fbc0312b
121332024-11-21T01:28:16.375ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121342024-11-21T01:28:16.375ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121352024-11-21T01:28:16.375ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d4a515c0-3868-4ed3-a8d1-6c58fbc0312b")}) node_id = 1 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121362024-11-21T01:28:16.380ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121372024-11-21T01:28:16.380ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121382024-11-21T01:28:16.384ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121392024-11-21T01:28:16.384ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121402024-11-21T01:28:16.387ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121412024-11-21T01:28:16.387ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121422024-11-21T01:28:16.393ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121432024-11-21T01:28:16.396ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c
121442024-11-21T01:28:16.396ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UpdateNetworkConfig
121452024-11-21T01:28:16.396ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UpdateNetworkConfig
121462024-11-21T01:28:16.399ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UpdateNetworkConfig
121472024-11-21T01:28:16.399ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UpdateNetworkConfig
121482024-11-21T01:28:16.401ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
121492024-11-21T01:28:16.401ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UpdateNetworkConfig
121502024-11-21T01:28:16.401ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UpdateNetworkConfig
121512024-11-21T01:28:16.403ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
121522024-11-21T01:28:16.403ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
121532024-11-21T01:28:16.404ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
121542024-11-21T01:28:16.405ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
121552024-11-21T01:28:16.406ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
121562024-11-21T01:28:16.406ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
121572024-11-21T01:28:16.406ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
121582024-11-21T01:28:16.413ZDEBGnexus: notifying dendrite of updates instance_id = Some(599adf06-e1ce-43d6-a3ad-60119136e26c (instance)) switch = switch0
121592024-11-21T01:28:16.413ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1675, tv_nsec: 310325812 } })
121602024-11-21T01:28:16.414ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
121612024-11-21T01:28:16.444ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
121622024-11-21T01:28:16.444ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
121632024-11-21T01:28:16.444ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b46767d-dccf-4ac4-ac72-2a89e21fdd6d", "content-length": "26", "date": "Thu, 21 Nov 2024 01:28:16 GMT"} })
121642024-11-21T01:28:16.444ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
121652024-11-21T01:28:16.445ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
121662024-11-21T01:28:16.473ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
121672024-11-21T01:28:16.474ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "e677c79a-4991-4325-be4d-d19f46fb3c24", "content-length": "4", "date": "Thu, 21 Nov 2024 01:28:16 GMT"} })
121682024-11-21T01:28:16.476ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121692024-11-21T01:28:16.476ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121702024-11-21T01:28:16.482ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121712024-11-21T01:28:16.482ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121722024-11-21T01:28:16.486ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
121732024-11-21T01:28:16.486ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
121742024-11-21T01:28:16.510ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-21T01:28:16.491713Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, time_modified: Some(2024-11-21T01:28:16.491713Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 7bc3193e-0379-4a52-8db0-fc186320043f, time_modified: Some(2024-11-21T01:28:16.491713Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121752024-11-21T01:28:16.511ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121762024-11-21T01:28:16.511ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121772024-11-21T01:28:16.515ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121782024-11-21T01:28:16.515ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121792024-11-21T01:28:16.523ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121802024-11-21T01:28:16.523ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UnassignOximeterProducer
121812024-11-21T01:28:16.523ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UnassignOximeterProducer
121822024-11-21T01:28:16.532ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 49435a09-4a28-49d2-bf6d-81a21cb92fe2 producer_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121832024-11-21T01:28:16.532ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UnassignOximeterProducer
121842024-11-21T01:28:16.532ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = UnassignOximeterProducer
121852024-11-21T01:28:16.567ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121862024-11-21T01:28:16.570ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/599adf06-e1ce-43d6-a3ad-60119136e26c
121872024-11-21T01:28:16.581ZDEBGnexus (SagaExecutor): client response oximeter-collector = 599adf06-e1ce-43d6-a3ad-60119136e26c result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/599adf06-e1ce-43d6-a3ad-60119136e26c", status: 204, headers: {"x-request-id": "4d1e1d8d-dba2-4471-b046-b185d34f9d15", "date": "Thu, 21 Nov 2024 01:28:16 GMT"} }) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121882024-11-21T01:28:16.581ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 49435a09-4a28-49d2-bf6d-81a21cb92fe2 producer_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121892024-11-21T01:28:16.584ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121902024-11-21T01:28:16.584ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121912024-11-21T01:28:16.588ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121922024-11-21T01:28:16.588ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121932024-11-21T01:28:16.592ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c lock = UpdaterLock { updater_id: d4a515c0-3868-4ed3-a8d1-6c58fbc0312b, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-21T01:28:16.274485821Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121942024-11-21T01:28:16.592ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = CommitInstanceUpdates
121952024-11-21T01:28:16.592ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = CommitInstanceUpdates
121962024-11-21T01:28:16.642ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c new_runtime = InstanceRuntimeState { time_updated: 2024-11-21T01:28:16.274485821Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
121972024-11-21T01:28:16.642ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
121982024-11-21T01:28:16.642ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
121992024-11-21T01:28:16.642ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
122002024-11-21T01:28:16.642ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
122012024-11-21T01:28:16.642ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
122022024-11-21T01:28:16.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122032024-11-21T01:28:16.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122042024-11-21T01:28:16.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122052024-11-21T01:28:16.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122062024-11-21T01:28:16.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122072024-11-21T01:28:16.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122082024-11-21T01:28:16.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122092024-11-21T01:28:16.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122102024-11-21T01:28:16.649ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122112024-11-21T01:28:16.649ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122122024-11-21T01:28:16.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122132024-11-21T01:28:16.651ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122142024-11-21T01:28:16.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122152024-11-21T01:28:16.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122162024-11-21T01:28:16.654ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122172024-11-21T01:28:16.654ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("599adf06-e1ce-43d6-a3ad-60119136e26c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("4929648b-7103-40a5-8a25-6d3cccfcb107")}) node_id = 7 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122182024-11-21T01:28:16.660ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122192024-11-21T01:28:16.660ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122202024-11-21T01:28:16.665ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122212024-11-21T01:28:16.665ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122222024-11-21T01:28:16.670ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122232024-11-21T01:28:16.670ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122242024-11-21T01:28:16.677ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
122252024-11-21T01:28:16.677ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ReleaseSledResources
122262024-11-21T01:28:16.677ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ReleaseSledResources
122272024-11-21T01:28:16.684ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
122282024-11-21T01:28:16.684ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122292024-11-21T01:28:16.685ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8b1c665-f305-4022-aa13-e89c28d8d2d6", "content-length": "372", "date": "Thu, 21 Nov 2024 01:28:16 GMT"} })
122302024-11-21T01:28:16.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122312024-11-21T01:28:16.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122322024-11-21T01:28:16.696ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122332024-11-21T01:28:16.696ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122342024-11-21T01:28:16.699ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122352024-11-21T01:28:16.700ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122362024-11-21T01:28:16.703ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c propolis_id = 4929648b-7103-40a5-8a25-6d3cccfcb107 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
122372024-11-21T01:28:16.703ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = MarkVmmDeleted
122382024-11-21T01:28:16.703ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = MarkVmmDeleted
122392024-11-21T01:28:16.713ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122402024-11-21T01:28:16.713ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122412024-11-21T01:28:16.717ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122422024-11-21T01:28:16.717ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122432024-11-21T01:28:16.724ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122442024-11-21T01:28:16.724ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122452024-11-21T01:28:16.728ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122462024-11-21T01:28:16.728ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122472024-11-21T01:28:16.732ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122482024-11-21T01:28:16.732ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122492024-11-21T01:28:16.733ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {0e167e7c-11ac-4d18-8839-a13ad5adaaaf: {10.151.2.176: {5bbbba5e-242a-4f60-896b-b52cb3be20ad}, 10.151.2.175: {5bbbba5e-242a-4f60-896b-b52cb3be20ad}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
122502024-11-21T01:28:16.733ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
122512024-11-21T01:28:16.734ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b1896c8a-43cb-4bad-a35c-220bd54ec3f0", "date": "Thu, 21 Nov 2024 01:28:16 GMT"} })
122522024-11-21T01:28:16.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122532024-11-21T01:28:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122542024-11-21T01:28:16.734ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122552024-11-21T01:28:16.734ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122562024-11-21T01:28:16.735ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122572024-11-21T01:28:16.736ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122582024-11-21T01:28:16.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122592024-11-21T01:28:16.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122602024-11-21T01:28:16.737ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122612024-11-21T01:28:16.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122622024-11-21T01:28:16.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122632024-11-21T01:28:16.740ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6, lookup_type: ById(6a5dc44f-15fe-425c-8fd5-53cfbe8f53d6) }, key: 7bc3193e-0379-4a52-8db0-fc186320043f, lookup_type: ById(7bc3193e-0379-4a52-8db0-fc186320043f) }, key: 599adf06-e1ce-43d6-a3ad-60119136e26c, lookup_type: ById(599adf06-e1ce-43d6-a3ad-60119136e26c) } result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122642024-11-21T01:28:16.740ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122652024-11-21T01:28:16.740ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_node = ChainSuccessorSaga
122662024-11-21T01:28:16.742ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
122672024-11-21T01:28:16.742ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122682024-11-21T01:28:16.743ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5feb5f46-f86b-4a26-8e49-04bea25d96e8", "date": "Thu, 21 Nov 2024 01:28:16 GMT"} })
122692024-11-21T01:28:16.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122702024-11-21T01:28:16.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122712024-11-21T01:28:16.745ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 102.318121ms iteration = 24 status = {}
122722024-11-21T01:28:16.746ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c karmic_state = WillReincarnate needs_reincarnation = false saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update
122732024-11-21T01:28:16.746ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122742024-11-21T01:28:16.746ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122752024-11-21T01:28:16.749ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122762024-11-21T01:28:16.749ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122772024-11-21T01:28:16.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122782024-11-21T01:28:16.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122792024-11-21T01:28:16.753ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122802024-11-21T01:28:16.753ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122812024-11-21T01:28:16.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122822024-11-21T01:28:16.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122832024-11-21T01:28:16.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122842024-11-21T01:28:16.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122852024-11-21T01:28:16.755ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122862024-11-21T01:28:16.755ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b5214ace-0b29-49db-a745-c81e7be220d1
122872024-11-21T01:28:16.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122882024-11-21T01:28:16.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122892024-11-21T01:28:16.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122902024-11-21T01:28:16.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122912024-11-21T01:28:16.789ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122922024-11-21T01:28:16.791ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 saga_name = instance-update saga_result = SagaResult { saga_id: b5214ace-0b29-49db-a745-c81e7be220d1, saga_log: SagaLog { saga_id: b5214ace-0b29-49db-a745-c81e7be220d1, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("d4a515c0-3868-4ed3-a8d1-6c58fbc0312b")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("d4a515c0-3868-4ed3-a8d1-6c58fbc0312b")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("599adf06-e1ce-43d6-a3ad-60119136e26c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("4929648b-7103-40a5-8a25-6d3cccfcb107")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("599adf06-e1ce-43d6-a3ad-60119136e26c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("4929648b-7103-40a5-8a25-6d3cccfcb107")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("d4a515c0-3868-4ed3-a8d1-6c58fbc0312b"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("d4a515c0-3868-4ed3-a8d1-6c58fbc0312b")}} }) }
122932024-11-21T01:28:16.791ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = b5214ace-0b29-49db-a745-c81e7be220d1 instance_id = 599adf06-e1ce-43d6-a3ad-60119136e26c saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update
122942024-11-21T01:28:16.791ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122952024-11-21T01:28:16.791ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
122962024-11-21T01:28:16.799ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122972024-11-21T01:28:16.799ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
122982024-11-21T01:28:16.802ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
122992024-11-21T01:28:16.802ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
123002024-11-21T01:28:16.805ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
123012024-11-21T01:28:16.805ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = c363f341-cd23-459b-8c41-bf7020a03af1
123022024-11-21T01:28:16.811ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update sec_id = 5382fba6-edea-49d2-8ecc-9b1edfc688be
123032024-11-21T01:28:16.811ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = c363f341-cd23-459b-8c41-bf7020a03af1 saga_name = start-instance-update saga_result = SagaResult { saga_id: c363f341-cd23-459b-8c41-bf7020a03af1, saga_log: SagaLog { saga_id: c363f341-cd23-459b-8c41-bf7020a03af1, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("270c85b2-4567-49d6-9260-d394698c85b5")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("270c85b2-4567-49d6-9260-d394698c85b5")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("270c85b2-4567-49d6-9260-d394698c85b5"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("270c85b2-4567-49d6-9260-d394698c85b5")}} }) }
123042024-11-21T01:28:16.851ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123052024-11-21T01:28:16.851ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f733f00-1032-4d53-b5c7-170e5ebe142a", "content-length": "691", "date": "Thu, 21 Nov 2024 01:28:16 GMT"} })
123062024-11-21T01:28:16.851ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
123072024-11-21T01:28:16.851ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
123082024-11-21T01:28:16.851ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
123092024-11-21T01:28:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 209.842398ms iteration = 24 status = {}
123102024-11-21T01:28:17.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ba08ee5-2ad2-40d1-8ab8-56b221fea19c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123112024-11-21T01:28:17.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ba08ee5-2ad2-40d1-8ab8-56b221fea19c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123122024-11-21T01:28:17.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7ba08ee5-2ad2-40d1-8ab8-56b221fea19c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123132024-11-21T01:28:17.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 45eb28a0-e3d8-496b-bd93-b18f78523dc5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
123142024-11-21T01:28:17.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 45eb28a0-e3d8-496b-bd93-b18f78523dc5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
123152024-11-21T01:28:17.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 45eb28a0-e3d8-496b-bd93-b18f78523dc5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
123162024-11-21T01:28:18.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7062f1d6-4622-4d65-b2be-b2a51e3faddd roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123172024-11-21T01:28:18.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7062f1d6-4622-4d65-b2be-b2a51e3faddd resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123182024-11-21T01:28:18.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 7062f1d6-4622-4d65-b2be-b2a51e3faddd response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123192024-11-21T01:28:18.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 19c04972-0556-4ca5-90f0-c90eb5918a99 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
123202024-11-21T01:28:18.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 19c04972-0556-4ca5-90f0-c90eb5918a99 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
123212024-11-21T01:28:18.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 19c04972-0556-4ca5-90f0-c90eb5918a99 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
123222024-11-21T01:28:18.492ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3224 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 5a809506-4c6a-4890-90b7-d1da9bd95baa response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
123232024-11-21T01:28:19.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 068a5659-bf08-4764-8616-0c5a70bfd17b roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123242024-11-21T01:28:19.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 068a5659-bf08-4764-8616-0c5a70bfd17b resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123252024-11-21T01:28:19.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 068a5659-bf08-4764-8616-0c5a70bfd17b response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123262024-11-21T01:28:20.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1b3656c9-3223-4ae4-9ef5-efd4d14645e9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123272024-11-21T01:28:20.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1b3656c9-3223-4ae4-9ef5-efd4d14645e9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123282024-11-21T01:28:20.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1b3656c9-3223-4ae4-9ef5-efd4d14645e9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123292024-11-21T01:28:21.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ba3b1065-99b1-40ea-93ff-1b353d7667ee roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123302024-11-21T01:28:21.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ba3b1065-99b1-40ea-93ff-1b353d7667ee resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123312024-11-21T01:28:21.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = ba3b1065-99b1-40ea-93ff-1b353d7667ee response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123322024-11-21T01:28:21.303ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
123332024-11-21T01:28:21.303ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123342024-11-21T01:28:21.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123352024-11-21T01:28:21.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
123362024-11-21T01:28:21.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123372024-11-21T01:28:21.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123382024-11-21T01:28:21.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123392024-11-21T01:28:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123402024-11-21T01:28:21.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123412024-11-21T01:28:21.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123422024-11-21T01:28:21.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123432024-11-21T01:28:21.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123442024-11-21T01:28:21.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123452024-11-21T01:28:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
123462024-11-21T01:28:21.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123472024-11-21T01:28:21.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123482024-11-21T01:28:21.327ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
123492024-11-21T01:28:21.327ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.215111ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
123502024-11-21T01:28:21.333ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123512024-11-21T01:28:21.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123522024-11-21T01:28:21.360ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.981769ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123532024-11-21T01:28:22.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d3aab203-995f-4195-a73a-47a6b63cdb33 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123542024-11-21T01:28:22.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d3aab203-995f-4195-a73a-47a6b63cdb33 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123552024-11-21T01:28:22.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d3aab203-995f-4195-a73a-47a6b63cdb33 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123562024-11-21T01:28:23.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d67be66-3c57-4699-8b71-9cbde4967ada roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123572024-11-21T01:28:23.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d67be66-3c57-4699-8b71-9cbde4967ada resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123582024-11-21T01:28:23.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 9d67be66-3c57-4699-8b71-9cbde4967ada response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123592024-11-21T01:28:24.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2708de6c-5ec5-4fde-9202-d692ad3bb566 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123602024-11-21T01:28:24.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2708de6c-5ec5-4fde-9202-d692ad3bb566 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123612024-11-21T01:28:24.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2708de6c-5ec5-4fde-9202-d692ad3bb566 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123622024-11-21T01:28:25.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 43ccc050-4a28-49b6-b0da-795e0ded807a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123632024-11-21T01:28:25.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 43ccc050-4a28-49b6-b0da-795e0ded807a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123642024-11-21T01:28:25.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 43ccc050-4a28-49b6-b0da-795e0ded807a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123652024-11-21T01:28:26.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d0aa52c-2505-49ce-88c4-13ef78167588 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123662024-11-21T01:28:26.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d0aa52c-2505-49ce-88c4-13ef78167588 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123672024-11-21T01:28:26.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d0aa52c-2505-49ce-88c4-13ef78167588 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123682024-11-21T01:28:27.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0df60d1d-93e0-4249-a548-4962206fe164 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123692024-11-21T01:28:27.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0df60d1d-93e0-4249-a548-4962206fe164 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123702024-11-21T01:28:27.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 0df60d1d-93e0-4249-a548-4962206fe164 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123712024-11-21T01:28:28.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31a52da1-6c41-405e-8cce-84fba271ad29 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123722024-11-21T01:28:28.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31a52da1-6c41-405e-8cce-84fba271ad29 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123732024-11-21T01:28:28.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 31a52da1-6c41-405e-8cce-84fba271ad29 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123742024-11-21T01:28:29.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dcdb9d63-62ec-4114-b1ea-e3efc4e99666 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123752024-11-21T01:28:29.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dcdb9d63-62ec-4114-b1ea-e3efc4e99666 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123762024-11-21T01:28:29.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = dcdb9d63-62ec-4114-b1ea-e3efc4e99666 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123772024-11-21T01:28:30.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 17a66a12-8c8b-456b-9b5a-d49ae5971011 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123782024-11-21T01:28:30.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 17a66a12-8c8b-456b-9b5a-d49ae5971011 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123792024-11-21T01:28:30.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 17a66a12-8c8b-456b-9b5a-d49ae5971011 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
123802024-11-21T01:28:31.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
123812024-11-21T01:28:31.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123822024-11-21T01:28:31.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123832024-11-21T01:28:31.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
123842024-11-21T01:28:31.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123852024-11-21T01:28:31.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123862024-11-21T01:28:31.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123872024-11-21T01:28:31.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123882024-11-21T01:28:31.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123892024-11-21T01:28:31.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.641581ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123902024-11-21T01:28:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123912024-11-21T01:28:31.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123922024-11-21T01:28:31.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123932024-11-21T01:28:31.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123942024-11-21T01:28:31.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123952024-11-21T01:28:31.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123962024-11-21T01:28:31.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
123972024-11-21T01:28:31.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123982024-11-21T01:28:31.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123992024-11-21T01:28:31.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
124002024-11-21T01:28:31.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.85051ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
124012024-11-21T01:28:31.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 34c9be79-b5da-4dbd-837c-21e048984f7e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124022024-11-21T01:28:31.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 34c9be79-b5da-4dbd-837c-21e048984f7e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124032024-11-21T01:28:31.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 34c9be79-b5da-4dbd-837c-21e048984f7e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124042024-11-21T01:28:32.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d6bf0964-71b1-46b4-a93f-0db70814b55e roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124052024-11-21T01:28:32.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d6bf0964-71b1-46b4-a93f-0db70814b55e resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124062024-11-21T01:28:32.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d6bf0964-71b1-46b4-a93f-0db70814b55e response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124072024-11-21T01:28:33.491ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1089 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = 861eb6b9-80ed-45bd-883a-a13257ecb459 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
124082024-11-21T01:28:33.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd434f35-e011-4750-b1b0-f8f3386752a7 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124092024-11-21T01:28:33.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd434f35-e011-4750-b1b0-f8f3386752a7 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124102024-11-21T01:28:33.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = bd434f35-e011-4750-b1b0-f8f3386752a7 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124112024-11-21T01:28:34.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8379eb9e-f212-48b8-a58d-57beae15e646 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124122024-11-21T01:28:34.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8379eb9e-f212-48b8-a58d-57beae15e646 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124132024-11-21T01:28:34.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8379eb9e-f212-48b8-a58d-57beae15e646 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124142024-11-21T01:28:35.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1c3ba9ea-a43c-446a-a10c-2de5343bfc8d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124152024-11-21T01:28:35.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1c3ba9ea-a43c-446a-a10c-2de5343bfc8d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124162024-11-21T01:28:35.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 1c3ba9ea-a43c-446a-a10c-2de5343bfc8d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124172024-11-21T01:28:36.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = efe502ee-cc3a-4767-944f-43eb8f6c8fb1 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124182024-11-21T01:28:36.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = efe502ee-cc3a-4767-944f-43eb8f6c8fb1 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124192024-11-21T01:28:36.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = efe502ee-cc3a-4767-944f-43eb8f6c8fb1 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124202024-11-21T01:28:37.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 75bfbe20-eaa4-4819-9026-f02ff58be788 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124212024-11-21T01:28:37.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 75bfbe20-eaa4-4819-9026-f02ff58be788 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124222024-11-21T01:28:37.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 75bfbe20-eaa4-4819-9026-f02ff58be788 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124232024-11-21T01:28:38.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 13ff4eff-e771-4eeb-97ab-5252ccd14de2 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124242024-11-21T01:28:38.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 13ff4eff-e771-4eeb-97ab-5252ccd14de2 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124252024-11-21T01:28:38.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 13ff4eff-e771-4eeb-97ab-5252ccd14de2 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124262024-11-21T01:28:39.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a77b544b-ca79-4bc0-be44-c1e5eaa88206 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124272024-11-21T01:28:39.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a77b544b-ca79-4bc0-be44-c1e5eaa88206 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124282024-11-21T01:28:39.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = a77b544b-ca79-4bc0-be44-c1e5eaa88206 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124292024-11-21T01:28:40.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b63c1a03-bb33-4654-b67a-8ec0bd464fee roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124302024-11-21T01:28:40.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b63c1a03-bb33-4654-b67a-8ec0bd464fee resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124312024-11-21T01:28:40.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b63c1a03-bb33-4654-b67a-8ec0bd464fee response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
124322024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
124332024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
124342024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124352024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
124362024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
124372024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
124382024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124392024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
124402024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
124412024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124422024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
124432024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124442024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124452024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
124462024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
124472024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124482024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124492024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
124502024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124512024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
124522024-11-21T01:28:41.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124532024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124542024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124552024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124562024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124572024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
124582024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
124592024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
124602024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124612024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124622024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
124632024-11-21T01:28:41.305ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
124642024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124652024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
124662024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
124672024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
124682024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124692024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
124702024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
124712024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
124722024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
124732024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
124742024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
124752024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124762024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124772024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
124782024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
124792024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124802024-11-21T01:28:41.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124812024-11-21T01:28:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
124822024-11-21T01:28:41.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
124832024-11-21T01:28:41.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124842024-11-21T01:28:41.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1700, tv_nsec: 204146536 } })
124852024-11-21T01:28:41.307ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
124862024-11-21T01:28:41.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124872024-11-21T01:28:41.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124882024-11-21T01:28:41.309ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.708016ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
124892024-11-21T01:28:41.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124902024-11-21T01:28:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124912024-11-21T01:28:41.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124922024-11-21T01:28:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124932024-11-21T01:28:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
124942024-11-21T01:28:41.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124952024-11-21T01:28:41.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124962024-11-21T01:28:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124972024-11-21T01:28:41.312ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124982024-11-21T01:28:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
124992024-11-21T01:28:41.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125002024-11-21T01:28:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125012024-11-21T01:28:41.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125022024-11-21T01:28:41.313ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1700, tv_nsec: 210374923 } })
125032024-11-21T01:28:41.314ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
125042024-11-21T01:28:41.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125052024-11-21T01:28:41.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125062024-11-21T01:28:41.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.432493ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
125072024-11-21T01:28:41.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125082024-11-21T01:28:41.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125092024-11-21T01:28:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125102024-11-21T01:28:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
125112024-11-21T01:28:41.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125122024-11-21T01:28:41.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
125132024-11-21T01:28:41.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.221408ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
125142024-11-21T01:28:41.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125152024-11-21T01:28:41.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125162024-11-21T01:28:41.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125172024-11-21T01:28:41.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125182024-11-21T01:28:41.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125192024-11-21T01:28:41.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125202024-11-21T01:28:41.324ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-623db7ea-cdeb-43ac-a5e8-f5c9bffff048.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1700, tv_nsec: 220769690 } })
125212024-11-21T01:28:41.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125222024-11-21T01:28:41.324ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
125232024-11-21T01:28:41.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125242024-11-21T01:28:41.326ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125252024-11-21T01:28:41.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125262024-11-21T01:28:41.349ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125272024-11-21T01:28:41.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125282024-11-21T01:28:41.352ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125292024-11-21T01:28:41.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125302024-11-21T01:28:41.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125312024-11-21T01:28:41.354ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
125322024-11-21T01:28:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125332024-11-21T01:28:41.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
125342024-11-21T01:28:41.356ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125352024-11-21T01:28:41.356ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
125362024-11-21T01:28:41.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125372024-11-21T01:28:41.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125382024-11-21T01:28:41.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125392024-11-21T01:28:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
125402024-11-21T01:28:41.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125412024-11-21T01:28:41.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125422024-11-21T01:28:41.360ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125432024-11-21T01:28:41.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125442024-11-21T01:28:41.360ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
125452024-11-21T01:28:41.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
125462024-11-21T01:28:41.365ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
125472024-11-21T01:28:41.365ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.954615ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
125482024-11-21T01:28:41.368ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125492024-11-21T01:28:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
125502024-11-21T01:28:41.370ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125512024-11-21T01:28:41.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125522024-11-21T01:28:41.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
125532024-11-21T01:28:41.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.303389ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
125542024-11-21T01:28:41.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
125552024-11-21T01:28:41.382ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125562024-11-21T01:28:41.383ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6693cfa8-7240-4a59-9b60-dbb9935c028e", "content-length": "26", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
125572024-11-21T01:28:41.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125582024-11-21T01:28:41.383ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125592024-11-21T01:28:41.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125602024-11-21T01:28:41.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 623db7ea-cdeb-43ac-a5e8-f5c9bffff048, lookup_type: ById(623db7ea-cdeb-43ac-a5e8-f5c9bffff048) } result = Ok(())
125612024-11-21T01:28:41.386ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125622024-11-21T01:28:41.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125632024-11-21T01:28:41.388ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.007844ms iteration = 24 status = 0
125642024-11-21T01:28:41.389ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125652024-11-21T01:28:41.389ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
125662024-11-21T01:28:41.389ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125672024-11-21T01:28:41.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125682024-11-21T01:28:41.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.815916ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
125692024-11-21T01:28:41.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.167749ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125702024-11-21T01:28:41.400ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125712024-11-21T01:28:41.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125722024-11-21T01:28:41.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.180748ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
125732024-11-21T01:28:41.404ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
125742024-11-21T01:28:41.404ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125752024-11-21T01:28:41.404ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb4f29ac-e88a-4e4f-bd30-2451fb330b67", "content-length": "26", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
125762024-11-21T01:28:41.404ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125772024-11-21T01:28:41.407ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125782024-11-21T01:28:41.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125792024-11-21T01:28:41.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125802024-11-21T01:28:41.430ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125812024-11-21T01:28:41.430ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
125822024-11-21T01:28:41.430ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.491744ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
125832024-11-21T01:28:41.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 130.63329ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
125842024-11-21T01:28:41.459ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c zone_address = fd00:1122:3344:101::2
125852024-11-21T01:28:41.459ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125862024-11-21T01:28:41.459ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19b5edbb-fdb2-4a53-a8d2-751a92c05810", "content-length": "26", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
125872024-11-21T01:28:41.459ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125882024-11-21T01:28:41.461ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
125892024-11-21T01:28:41.467ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.080658ms iteration = 27 status = {"physical_disks_added":0}
125902024-11-21T01:28:41.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125912024-11-21T01:28:41.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125922024-11-21T01:28:41.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125932024-11-21T01:28:41.517ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125942024-11-21T01:28:41.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125952024-11-21T01:28:41.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125962024-11-21T01:28:41.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125972024-11-21T01:28:41.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125982024-11-21T01:28:41.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125992024-11-21T01:28:41.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126002024-11-21T01:28:41.528ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
126012024-11-21T01:28:41.529ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "33c36916-d50b-4666-9839-927107b3e9ed", "content-length": "2", "date": "Thu, 21 Nov 2024 01:28:40 GMT"} })
126022024-11-21T01:28:41.530ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126032024-11-21T01:28:41.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126042024-11-21T01:28:41.532ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.662908ms iteration = 24 status = null
126052024-11-21T01:28:41.544ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 240.068713ms iteration = 24 status = {}
126062024-11-21T01:28:41.548ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
126072024-11-21T01:28:41.548ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126082024-11-21T01:28:41.548ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "201e4a4f-654b-4adc-b0de-7d4dd1eefb61", "content-length": "372", "date": "Thu, 21 Nov 2024 01:28:40 GMT"} })
126092024-11-21T01:28:41.548ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126102024-11-21T01:28:41.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126112024-11-21T01:28:41.590ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
126122024-11-21T01:28:41.590ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
126132024-11-21T01:28:41.594ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
126142024-11-21T01:28:41.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126152024-11-21T01:28:41.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126162024-11-21T01:28:41.655ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 4bb6bcd4-1c7e-44ca-9ba3-de40a6189fe8, rack_id: e0f91ea1-f368-4705-9818-7568a8475d7c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(251325f4-120e-4313-934e-59e47b2a36f6) } rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
126172024-11-21T01:28:41.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126182024-11-21T01:28:41.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126192024-11-21T01:28:41.656ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b77ee35f-deca-4018-a258-b26f4f8be14b", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
126202024-11-21T01:28:41.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126212024-11-21T01:28:41.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126222024-11-21T01:28:41.656ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "924b8b0e-31fb-4bcb-94e2-dea5f19e7d70", "content-length": "691", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
126232024-11-21T01:28:41.656ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
126242024-11-21T01:28:41.657ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
126252024-11-21T01:28:41.657ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
126262024-11-21T01:28:41.658ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 354.212302ms iteration = 25 status = {}
126272024-11-21T01:28:41.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126282024-11-21T01:28:41.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126292024-11-21T01:28:41.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126302024-11-21T01:28:41.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126312024-11-21T01:28:41.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
126322024-11-21T01:28:41.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6288290f-bdc8-4d00-8bc1-535feaa45267", "content-length": "134", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
126332024-11-21T01:28:41.664ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
126342024-11-21T01:28:41.664ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 251325f4-120e-4313-934e-59e47b2a36f6
126352024-11-21T01:28:41.664ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
126362024-11-21T01:28:41.664ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
126372024-11-21T01:28:41.664ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126382024-11-21T01:28:41.664ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126392024-11-21T01:28:41.664ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126402024-11-21T01:28:41.665ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126412024-11-21T01:28:41.665ZINFOnexus (BackgroundTasks): VPC route manager sled 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
126422024-11-21T01:28:41.665ZDEBGnexus (BackgroundTasks): client request SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126432024-11-21T01:28:41.665ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126442024-11-21T01:28:41.665ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126452024-11-21T01:28:41.665ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c
126462024-11-21T01:28:41.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126472024-11-21T01:28:41.665ZDEBGnexus (BackgroundTasks): client response SledAgent = 623db7ea-cdeb-43ac-a5e8-f5c9bffff048 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "086a5e71-d63f-4fec-b155-e54f52034762", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
126482024-11-21T01:28:41.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126492024-11-21T01:28:41.666ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 361.363742ms iteration = 25 status = {}
126502024-11-21T01:28:41.667ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
126512024-11-21T01:28:41.667ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fa80400-bc2b-42ce-8bbf-9b3aa9345b5f", "content-length": "2", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
126522024-11-21T01:28:41.667ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
126532024-11-21T01:28:41.667ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "45108a38-2715-4383-8258-e6c0a6f5fdee", "content-length": "51", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
126542024-11-21T01:28:41.667ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch_location = Switch0
126552024-11-21T01:28:41.667ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
126562024-11-21T01:28:41.771ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4bad68d1-0562-4767-b576-2afd0b12bdc4", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
126572024-11-21T01:28:41.771ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c switch = Switch0
126582024-11-21T01:28:41.771ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
126592024-11-21T01:28:41.771ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = e0f91ea1-f368-4705-9818-7568a8475d7c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "12e61948-3c89-4cd9-8ad9-7aa6aca696f5", "content-length": "682", "date": "Thu, 21 Nov 2024 01:28:41 GMT"} })
126602024-11-21T01:28:41.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126612024-11-21T01:28:41.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126622024-11-21T01:28:41.775ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126632024-11-21T01:28:41.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126642024-11-21T01:28:41.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126652024-11-21T01:28:41.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126662024-11-21T01:28:41.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126672024-11-21T01:28:41.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126682024-11-21T01:28:41.788ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 484.091661ms iteration = 24 status = {}
126692024-11-21T01:28:41.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d4812448-f591-4716-8867-c3d24658b9af roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126702024-11-21T01:28:41.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d4812448-f591-4716-8867-c3d24658b9af resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126712024-11-21T01:28:41.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d4812448-f591-4716-8867-c3d24658b9af response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126722024-11-21T01:28:42.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aa106daf-f886-4f71-b126-8de184b00149 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126732024-11-21T01:28:42.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aa106daf-f886-4f71-b126-8de184b00149 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126742024-11-21T01:28:42.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = aa106daf-f886-4f71-b126-8de184b00149 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126752024-11-21T01:28:43.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d6a69d0e-6a8c-401d-bbe3-33287a5d04ea roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126762024-11-21T01:28:43.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d6a69d0e-6a8c-401d-bbe3-33287a5d04ea resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126772024-11-21T01:28:43.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = d6a69d0e-6a8c-401d-bbe3-33287a5d04ea response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126782024-11-21T01:28:44.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 54e4ad46-e1c5-4f43-b20d-897ebe32c197 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126792024-11-21T01:28:44.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 54e4ad46-e1c5-4f43-b20d-897ebe32c197 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126802024-11-21T01:28:44.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 54e4ad46-e1c5-4f43-b20d-897ebe32c197 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126812024-11-21T01:28:45.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 152c373a-b1cd-43b8-850f-1125d9b31cbb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126822024-11-21T01:28:45.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 152c373a-b1cd-43b8-850f-1125d9b31cbb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126832024-11-21T01:28:45.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 152c373a-b1cd-43b8-850f-1125d9b31cbb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126842024-11-21T01:28:46.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b06006c7-ca34-4937-bc0f-59e48a8ad57d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126852024-11-21T01:28:46.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b06006c7-ca34-4937-bc0f-59e48a8ad57d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126862024-11-21T01:28:46.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b06006c7-ca34-4937-bc0f-59e48a8ad57d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126872024-11-21T01:28:47.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 451fc227-6390-42ab-a490-75015831be9a roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126882024-11-21T01:28:47.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 451fc227-6390-42ab-a490-75015831be9a resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126892024-11-21T01:28:47.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 451fc227-6390-42ab-a490-75015831be9a response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126902024-11-21T01:28:48.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 0712afe7-de8b-4459-8468-7ec097654f0f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126912024-11-21T01:28:48.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 0712afe7-de8b-4459-8468-7ec097654f0f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126922024-11-21T01:28:48.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45020 req_id = 0712afe7-de8b-4459-8468-7ec097654f0f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126932024-11-21T01:28:48.491ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 637 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = ef17ab5d-4b64-4293-89f4-54940f55ad48 response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
126942024-11-21T01:28:48.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c81f3218-eb13-4497-a80a-1ca18dd2e105 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126952024-11-21T01:28:48.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c81f3218-eb13-4497-a80a-1ca18dd2e105 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126962024-11-21T01:28:48.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c81f3218-eb13-4497-a80a-1ca18dd2e105 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126972024-11-21T01:28:49.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c1a98670-eb9f-4565-b60e-ad7371021bf8 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126982024-11-21T01:28:49.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c1a98670-eb9f-4565-b60e-ad7371021bf8 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
126992024-11-21T01:28:49.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = c1a98670-eb9f-4565-b60e-ad7371021bf8 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127002024-11-21T01:28:51.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86045c3c-4c46-4f6b-9dfa-e15322577742 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127012024-11-21T01:28:51.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86045c3c-4c46-4f6b-9dfa-e15322577742 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127022024-11-21T01:28:51.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 86045c3c-4c46-4f6b-9dfa-e15322577742 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127032024-11-21T01:28:51.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
127042024-11-21T01:28:51.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
127052024-11-21T01:28:51.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127062024-11-21T01:28:51.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127072024-11-21T01:28:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127082024-11-21T01:28:51.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127092024-11-21T01:28:51.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127102024-11-21T01:28:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127112024-11-21T01:28:51.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127122024-11-21T01:28:51.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127132024-11-21T01:28:51.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127142024-11-21T01:28:51.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127152024-11-21T01:28:51.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127162024-11-21T01:28:51.342ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127172024-11-21T01:28:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127182024-11-21T01:28:51.343ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
127192024-11-21T01:28:51.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127202024-11-21T01:28:51.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127212024-11-21T01:28:51.344ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.102455ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127222024-11-21T01:28:51.357ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
127232024-11-21T01:28:51.357ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.631742ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
127242024-11-21T01:28:52.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 228958e2-8627-4910-96fd-7cbbd52860fb roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127252024-11-21T01:28:52.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 228958e2-8627-4910-96fd-7cbbd52860fb resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127262024-11-21T01:28:52.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 228958e2-8627-4910-96fd-7cbbd52860fb response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127272024-11-21T01:28:53.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 345df816-eb66-40fa-912e-324c63903a0c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127282024-11-21T01:28:53.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 345df816-eb66-40fa-912e-324c63903a0c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127292024-11-21T01:28:53.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 345df816-eb66-40fa-912e-324c63903a0c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127302024-11-21T01:28:54.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8cf83250-f059-4eac-8178-008aa5d6c84c roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127312024-11-21T01:28:54.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8cf83250-f059-4eac-8178-008aa5d6c84c resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127322024-11-21T01:28:54.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8cf83250-f059-4eac-8178-008aa5d6c84c response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127332024-11-21T01:28:55.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbaecc10-89ae-4518-9d27-ab090429d705 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127342024-11-21T01:28:55.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbaecc10-89ae-4518-9d27-ab090429d705 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127352024-11-21T01:28:55.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = fbaecc10-89ae-4518-9d27-ab090429d705 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127362024-11-21T01:28:56.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f0b1739b-2177-442a-b625-45362d611576 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127372024-11-21T01:28:56.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f0b1739b-2177-442a-b625-45362d611576 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127382024-11-21T01:28:56.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f0b1739b-2177-442a-b625-45362d611576 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127392024-11-21T01:28:57.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6bc175f-ed95-4a58-a561-8b501f76eb87 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127402024-11-21T01:28:57.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6bc175f-ed95-4a58-a561-8b501f76eb87 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127412024-11-21T01:28:57.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = b6bc175f-ed95-4a58-a561-8b501f76eb87 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127422024-11-21T01:28:58.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 045467de-aff5-458a-8ec0-e54d113913b9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127432024-11-21T01:28:58.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 045467de-aff5-458a-8ec0-e54d113913b9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127442024-11-21T01:28:58.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 045467de-aff5-458a-8ec0-e54d113913b9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127452024-11-21T01:28:59.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 040a334c-e7b4-4144-bfdf-662d68155645 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127462024-11-21T01:28:59.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 040a334c-e7b4-4144-bfdf-662d68155645 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127472024-11-21T01:28:59.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 040a334c-e7b4-4144-bfdf-662d68155645 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127482024-11-21T01:29:00.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f200fb2b-5720-4c7c-aa58-9cbbc77439ff roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127492024-11-21T01:29:00.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f200fb2b-5720-4c7c-aa58-9cbbc77439ff resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127502024-11-21T01:29:00.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = f200fb2b-5720-4c7c-aa58-9cbbc77439ff response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127512024-11-21T01:29:01.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3bde4eee-a891-459b-831d-cb1b1e81ec25 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127522024-11-21T01:29:01.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3bde4eee-a891-459b-831d-cb1b1e81ec25 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127532024-11-21T01:29:01.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 3bde4eee-a891-459b-831d-cb1b1e81ec25 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127542024-11-21T01:29:01.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
127552024-11-21T01:29:01.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127562024-11-21T01:29:01.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127572024-11-21T01:29:01.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
127582024-11-21T01:29:01.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127592024-11-21T01:29:01.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127602024-11-21T01:29:01.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127612024-11-21T01:29:01.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127622024-11-21T01:29:01.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127632024-11-21T01:29:01.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127642024-11-21T01:29:01.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127652024-11-21T01:29:01.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127662024-11-21T01:29:01.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127672024-11-21T01:29:01.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127682024-11-21T01:29:01.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127692024-11-21T01:29:01.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0fc05eef-53b8-45f6-a84d-0d37a52fd074, lookup_type: ById(0fc05eef-53b8-45f6-a84d-0d37a52fd074) } result = Ok(())
127702024-11-21T01:29:01.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127712024-11-21T01:29:01.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127722024-11-21T01:29:01.328ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 original_time_created = 2024-11-21 01:17:01.888101 UTC target_id = 0fc05eef-53b8-45f6-a84d-0d37a52fd074 time_created = 2024-11-21 01:17:01.888101 UTC
127732024-11-21T01:29:01.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.377603ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0fc05eef-53b8-45f6-a84d-0d37a52fd074","time_created":"2024-11-21T01:17:01.888101Z"}
127742024-11-21T01:29:01.339ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.541617ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127752024-11-21T01:29:02.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 27bb5936-1e75-40ca-8fd1-0b9ae7804f8d roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127762024-11-21T01:29:02.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 27bb5936-1e75-40ca-8fd1-0b9ae7804f8d resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127772024-11-21T01:29:02.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 27bb5936-1e75-40ca-8fd1-0b9ae7804f8d response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127782024-11-21T01:29:03.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 296dd698-e8ee-4e45-aa77-e2489880279f roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127792024-11-21T01:29:03.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 296dd698-e8ee-4e45-aa77-e2489880279f resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127802024-11-21T01:29:03.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 296dd698-e8ee-4e45-aa77-e2489880279f response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127812024-11-21T01:29:03.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 597 local_addr = [fd00:1122:3344:101::c]:37039 method = GET remote_addr = [fd00:1122:3344:101::d]:35787 req_id = ce244934-42f6-450b-82c7-5472bdf979cc response_code = 200 uri = /5382fba6-edea-49d2-8ecc-9b1edfc688be
127822024-11-21T01:29:04.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5e4fb849-57f7-4211-9e48-849f0e1f0c60 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127832024-11-21T01:29:04.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5e4fb849-57f7-4211-9e48-849f0e1f0c60 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127842024-11-21T01:29:04.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 5e4fb849-57f7-4211-9e48-849f0e1f0c60 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127852024-11-21T01:29:05.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d92e863-d401-46a8-9fea-f533bcbba3b9 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127862024-11-21T01:29:05.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d92e863-d401-46a8-9fea-f533bcbba3b9 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127872024-11-21T01:29:05.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 8d92e863-d401-46a8-9fea-f533bcbba3b9 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127882024-11-21T01:29:06.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2cd28162-e912-4185-b7c8-927cb20a3e44 roles = RoleSet { roles: {} } uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127892024-11-21T01:29:06.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2cd28162-e912-4185-b7c8-927cb20a3e44 resource = Database result = Ok(()) uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048
127902024-11-21T01:29:06.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45145 req_id = 2cd28162-e912-4185-b7c8-927cb20a3e44 response_code = 200 uri = /probes/623db7ea-cdeb-43ac-a5e8-f5c9bffff048