Max level shown:
1 [ Nov 14 04:45:56 Enabled. ]
2 [ Nov 14 04:45:56 Rereading configuration. ]
3 [ Nov 14 04:46:00 Rereading configuration. ]
4 [ Nov 14 04:46:09 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 14 04:46:09 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-14T04:46:09.401ZDEBGnexus: registered DTrace probes
82024-11-14T04:46:09.403ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-14T04:46:09.412ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-14T04:46:09.412ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-14T04:46:09.428ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-14T04:46:09.431ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-14T04:46:09.434ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-14T04:46:09.442ZDEBGnexus (ServerContext): registered USDT probes
672024-11-14T04:46:09.463ZINFOnexus: Database schema version is up to date desired_version = 114.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 114.0.0
682024-11-14T04:46:09.466ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 79994e02-6747-4071-83af-7872b31640fb
692024-11-14T04:46:09.466ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 948, tv_nsec: 238651058 } })
702024-11-14T04:46:09.466ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
712024-11-14T04:46:09.514ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
722024-11-14T04:46:09.515ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-14T04:46:09.518ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7bf032b-c66d-435f-bc33-29cb4736b7ca", "content-length": "26", "date": "Thu, 14 Nov 2024 04:46:09 GMT"} })
742024-11-14T04:46:09.518ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-14T04:46:09.519ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-14T04:46:09.550ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 948, tv_nsec: 322525877 } })
772024-11-14T04:46:09.550ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
782024-11-14T04:46:09.583ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
792024-11-14T04:46:09.583ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-14T04:46:09.583ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf048f78-6268-4328-9bd4-ed3782366049", "content-length": "26", "date": "Thu, 14 Nov 2024 04:46:09 GMT"} })
812024-11-14T04:46:09.583ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-14T04:46:09.584ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-14T04:46:09.656ZDEBGnexus (clickhouse-client): registered USDT probes id = b3f9aa96-5f4b-495f-a59c-92427c15b2fb
842024-11-14T04:46:09.656ZDEBGnexus (clickhouse-client): registered USDT probes id = b3f9aa96-5f4b-495f-a59c-92427c15b2fb
852024-11-14T04:46:09.667ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-11-14T04:46:09.685ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-11-14T04:46:09.687ZDEBGnexus (DataLoader): attempting to create built-in users
882024-11-14T04:46:09.687ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892024-11-14T04:46:09.687ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
912024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
922024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
932024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
942024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
952024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
962024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
972024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
982024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
992024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
1002024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1012024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1022024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1032024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1042024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1062024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1072024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1082024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1092024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1102024-11-14T04:46:09.713ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1112024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1122024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1132024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1142024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1152024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1162024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1172024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1182024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1192024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1202024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1212024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1222024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1232024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1242024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1252024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1262024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1272024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1282024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1292024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1302024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1312024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1322024-11-14T04:46:09.714ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1332024-11-14T04:46:09.714ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1342024-11-14T04:46:09.714ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1352024-11-14T04:46:09.715ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1362024-11-14T04:46:10.127ZWARNnexus: Cannot look up rack: Object (of type ById(f971eb12-0fea-4084-96d3-74198bddd289)) not found: rack file = nexus/src/app/rack.rs:774
1372024-11-14T04:46:10.175ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1382024-11-14T04:46:10.176ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1392024-11-14T04:46:10.177ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1402024-11-14T04:46:10.177ZDEBGnexus (DataLoader): attempting to create built-in roles
1412024-11-14T04:46:10.177ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1422024-11-14T04:46:10.178ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1432024-11-14T04:46:10.198ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:47105
1442024-11-14T04:46:10.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 45ef1fa3-7548-44aa-a3ef-c59c064b8226 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1452024-11-14T04:46:10.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 45ef1fa3-7548-44aa-a3ef-c59c064b8226 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1462024-11-14T04:46:10.245ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1472024-11-14T04:46:10.245ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1482024-11-14T04:46:10.246ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1492024-11-14T04:46:10.246ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1502024-11-14T04:46:10.246ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-11-14T04:46:10.247ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-11-14T04:46:10.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 45ef1fa3-7548-44aa-a3ef-c59c064b8226 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1532024-11-14T04:46:10.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = e0bb7858-6293-4b74-84d6-8c2195b06745 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1542024-11-14T04:46:10.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = e0bb7858-6293-4b74-84d6-8c2195b06745 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1552024-11-14T04:46:10.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = e0bb7858-6293-4b74-84d6-8c2195b06745 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1562024-11-14T04:46:10.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = fd878556-ba93-4d81-8014-477789a325cd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1572024-11-14T04:46:10.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = fd878556-ba93-4d81-8014-477789a325cd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1582024-11-14T04:46:10.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = fd878556-ba93-4d81-8014-477789a325cd response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1592024-11-14T04:46:10.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = a953a95a-9dbc-4ece-8287-29b8245e37e8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1602024-11-14T04:46:10.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = a953a95a-9dbc-4ece-8287-29b8245e37e8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1612024-11-14T04:46:11.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = a953a95a-9dbc-4ece-8287-29b8245e37e8 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1622024-11-14T04:46:11.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 61cd6995-f784-4d79-a59a-eccb1e3a8466 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1632024-11-14T04:46:11.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 61cd6995-f784-4d79-a59a-eccb1e3a8466 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1642024-11-14T04:46:11.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 61cd6995-f784-4d79-a59a-eccb1e3a8466 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1652024-11-14T04:46:11.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = ccbfb9c8-f825-45f4-bded-4b15c3b6526f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1662024-11-14T04:46:11.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = ccbfb9c8-f825-45f4-bded-4b15c3b6526f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1672024-11-14T04:46:11.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = ccbfb9c8-f825-45f4-bded-4b15c3b6526f response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1682024-11-14T04:46:11.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f5d667fa-7c0e-4986-ae85-a18727b48a57 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
1692024-11-14T04:46:11.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f5d667fa-7c0e-4986-ae85-a18727b48a57 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
1702024-11-14T04:46:11.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f5d667fa-7c0e-4986-ae85-a18727b48a57 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
1712024-11-14T04:46:12.128ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1722024-11-14T04:46:12.128ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1732024-11-14T04:46:12.128ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:44853
1742024-11-14T04:46:12.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44853 req_id = 748fd8fa-c561-4950-827b-10c6e6e4fc9f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
1752024-11-14T04:46:12.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44853 req_id = 748fd8fa-c561-4950-827b-10c6e6e4fc9f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
1762024-11-14T04:46:12.129ZWARNnexus: Cannot look up rack: Object (of type ById(f971eb12-0fea-4084-96d3-74198bddd289)) not found: rack file = nexus/src/app/rack.rs:774
1772024-11-14T04:46:12.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44853 req_id = 748fd8fa-c561-4950-827b-10c6e6e4fc9f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
1782024-11-14T04:46:12.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44853 req_id = 71b74eb3-165d-4755-8040-d7b4588d9f30 roles = RoleSet { roles: {} } uri = /sled-agents/c073d51c-abaa-48df-abb6-2f053e9c1bec
1792024-11-14T04:46:12.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44853 req_id = 71b74eb3-165d-4755-8040-d7b4588d9f30 resource = Database result = Ok(()) uri = /sled-agents/c073d51c-abaa-48df-abb6-2f053e9c1bec
1802024-11-14T04:46:12.285ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1812024-11-14T04:46:12.285ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-11-14T04:46:12.286ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-11-14T04:46:12.286ZDEBGnexus (DataLoader): attempting to create built-in silos
1842024-11-14T04:46:12.286ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852024-11-14T04:46:12.286ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862024-11-14T04:46:12.406ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "c073d51c-abaa-48df-abb6-2f053e9c1bec" error_message_internal = not found: sled with id "c073d51c-abaa-48df-abb6-2f053e9c1bec" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 229996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:44853 req_id = 71b74eb3-165d-4755-8040-d7b4588d9f30 response_code = 404 uri = /sled-agents/c073d51c-abaa-48df-abb6-2f053e9c1bec
1872024-11-14T04:46:12.488ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62954
1882024-11-14T04:46:12.804ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1892024-11-14T04:46:12.804ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902024-11-14T04:46:12.805ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912024-11-14T04:46:12.823ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-11-14T04:46:12.824ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1932024-11-14T04:46:12.824ZDEBGnexus (DataLoader): attempting to create built-in projects
1942024-11-14T04:46:12.824ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1952024-11-14T04:46:12.824ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1962024-11-14T04:46:12.834ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1972024-11-14T04:46:12.835ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1982024-11-14T04:46:13.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd1f112c-ae79-4e6b-be58-345b4488443e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
1992024-11-14T04:46:13.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd1f112c-ae79-4e6b-be58-345b4488443e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
2002024-11-14T04:46:13.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd1f112c-ae79-4e6b-be58-345b4488443e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
2012024-11-14T04:46:13.572ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:53 sled_uuid = c073d51c-abaa-48df-abb6-2f053e9c1bec
2022024-11-14T04:46:13.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151731 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56b47ca4-1587-4354-87d7-5c6418f35d27 response_code = 204 uri = /sled-agents/c073d51c-abaa-48df-abb6-2f053e9c1bec
2032024-11-14T04:46:13.784ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-11-14T04:46:13.785ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052024-11-14T04:46:13.838ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-11-14T04:46:13.840ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2072024-11-14T04:46:13.840ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-11-14T04:46:13.840ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-11-14T04:46:13.841ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-11-14T04:46:13.842ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2112024-11-14T04:46:13.883ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-11-14T04:46:13.885ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
2132024-11-14T04:46:13.885ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-11-14T04:46:13.885ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-11-14T04:46:13.951ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
2162024-11-14T04:46:13.951ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2172024-11-14T04:46:13.952ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2182024-11-14T04:46:13.952ZDEBGnexus (DataLoader): attempting to create built-in VPCs
2192024-11-14T04:46:13.952ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-11-14T04:46:13.952ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-11-14T04:46:13.959ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-11-14T04:46:13.959ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-11-14T04:46:14.055ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-11-14T04:46:14.055ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-11-14T04:46:14.056ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-11-14T04:46:14.057ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-11-14T04:46:14.061ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-11-14T04:46:14.061ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292024-11-14T04:46:14.089ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-11-14T04:46:14.091ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2312024-11-14T04:46:14.091ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-11-14T04:46:14.091ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-11-14T04:46:14.093ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-11-14T04:46:14.093ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-11-14T04:46:14.095ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-11-14T04:46:14.095ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372024-11-14T04:46:14.096ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-11-14T04:46:14.098ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2392024-11-14T04:46:14.098ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-11-14T04:46:14.099ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-11-14T04:46:14.130ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2422024-11-14T04:46:14.130ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2432024-11-14T04:46:14.131ZWARNnexus: Cannot look up rack: Object (of type ById(f971eb12-0fea-4084-96d3-74198bddd289)) not found: rack file = nexus/src/app/rack.rs:774
2442024-11-14T04:46:14.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9b151d87-c2a0-421b-bb2b-c0b9af72a0cf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
2452024-11-14T04:46:14.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9b151d87-c2a0-421b-bb2b-c0b9af72a0cf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
2462024-11-14T04:46:14.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9b151d87-c2a0-421b-bb2b-c0b9af72a0cf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
2472024-11-14T04:46:14.375ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-11-14T04:46:14.376ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-11-14T04:46:14.377ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-11-14T04:46:14.378ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-11-14T04:46:14.379ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-11-14T04:46:14.379ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-11-14T04:46:14.381ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-11-14T04:46:14.384ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2552024-11-14T04:46:14.384ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-11-14T04:46:14.384ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2572024-11-14T04:46:14.393ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-11-14T04:46:14.393ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592024-11-14T04:46:14.406ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2602024-11-14T04:46:14.407ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2612024-11-14T04:46:14.409ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2622024-11-14T04:46:14.409ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2632024-11-14T04:46:14.425ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-11-14T04:46:14.425ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652024-11-14T04:46:14.427ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662024-11-14T04:46:14.427ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2672024-11-14T04:46:14.428ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682024-11-14T04:46:14.428ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692024-11-14T04:46:14.429ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702024-11-14T04:46:14.429ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2712024-11-14T04:46:14.431ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-11-14T04:46:14.434ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2732024-11-14T04:46:14.434ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-11-14T04:46:14.434ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-11-14T04:46:14.435ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-11-14T04:46:14.436ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2772024-11-14T04:46:14.437ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-11-14T04:46:14.437ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792024-11-14T04:46:14.438ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-11-14T04:46:14.441ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2812024-11-14T04:46:14.441ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822024-11-14T04:46:14.441ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2832024-11-14T04:46:14.588ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2842024-11-14T04:46:14.588ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2852024-11-14T04:46:14.589ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2862024-11-14T04:46:14.590ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2872024-11-14T04:46:14.591ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2882024-11-14T04:46:14.591ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2892024-11-14T04:46:14.593ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2902024-11-14T04:46:14.596ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2912024-11-14T04:46:14.596ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922024-11-14T04:46:14.596ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932024-11-14T04:46:14.662ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2942024-11-14T04:46:14.662ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-11-14T04:46:14.662ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-11-14T04:46:14.720ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-11-14T04:46:14.720ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-11-14T04:46:14.723ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-11-14T04:46:14.723ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002024-11-14T04:46:14.725ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-11-14T04:46:14.725ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-11-14T04:46:14.736ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-11-14T04:46:14.736ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-11-14T04:46:14.737ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-11-14T04:46:14.737ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-11-14T04:46:14.739ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-11-14T04:46:14.741ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3082024-11-14T04:46:14.741ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-11-14T04:46:14.742ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-11-14T04:46:14.743ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-11-14T04:46:14.743ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-11-14T04:46:14.745ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-11-14T04:46:14.745ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-11-14T04:46:14.746ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-11-14T04:46:14.749ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3162024-11-14T04:46:14.749ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-11-14T04:46:14.750ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182024-11-14T04:46:14.802ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-11-14T04:46:14.802ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-11-14T04:46:14.803ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-11-14T04:46:14.803ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-11-14T04:46:14.805ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-11-14T04:46:14.805ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-11-14T04:46:14.806ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-11-14T04:46:14.809ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3262024-11-14T04:46:14.809ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-11-14T04:46:14.809ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282024-11-14T04:46:14.895ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
3292024-11-14T04:46:14.895ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
3302024-11-14T04:46:14.895ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312024-11-14T04:46:14.896ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3322024-11-14T04:46:14.908ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332024-11-14T04:46:14.908ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342024-11-14T04:46:14.909ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-11-14T04:46:14.910ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-11-14T04:46:14.924ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-11-14T04:46:14.924ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-11-14T04:46:14.926ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-11-14T04:46:14.926ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402024-11-14T04:46:14.927ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-11-14T04:46:14.927ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422024-11-14T04:46:14.932ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-11-14T04:46:14.934ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3442024-11-14T04:46:14.934ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-11-14T04:46:14.935ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-11-14T04:46:14.942ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-11-14T04:46:14.942ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482024-11-14T04:46:14.944ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-11-14T04:46:14.944ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-11-14T04:46:14.946ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-11-14T04:46:14.946ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-11-14T04:46:14.947ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-11-14T04:46:14.947ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542024-11-14T04:46:14.948ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-11-14T04:46:14.949ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562024-11-14T04:46:14.950ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-11-14T04:46:14.950ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582024-11-14T04:46:14.952ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-11-14T04:46:14.956ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3602024-11-14T04:46:14.956ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612024-11-14T04:46:14.956ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622024-11-14T04:46:14.976ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-11-14T04:46:14.976ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642024-11-14T04:46:14.977ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652024-11-14T04:46:14.977ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3662024-11-14T04:46:14.978ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3672024-11-14T04:46:14.979ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3682024-11-14T04:46:14.980ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692024-11-14T04:46:14.982ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3702024-11-14T04:46:15.054ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-11-14T04:46:15.054ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-11-14T04:46:15.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 3f9dc9b7-9fb9-4adb-8073-0eda5050b484 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
3732024-11-14T04:46:15.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 3f9dc9b7-9fb9-4adb-8073-0eda5050b484 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
3742024-11-14T04:46:15.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 3f9dc9b7-9fb9-4adb-8073-0eda5050b484 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
3752024-11-14T04:46:15.151ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3762024-11-14T04:46:15.151ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3772024-11-14T04:46:15.165ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3782024-11-14T04:46:15.165ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3792024-11-14T04:46:15.166ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3802024-11-14T04:46:15.167ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3812024-11-14T04:46:15.168ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3822024-11-14T04:46:15.168ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3832024-11-14T04:46:15.169ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3842024-11-14T04:46:15.173ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3852024-11-14T04:46:15.173ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3862024-11-14T04:46:15.173ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3872024-11-14T04:46:15.215ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3882024-11-14T04:46:15.215ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3892024-11-14T04:46:15.219ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3902024-11-14T04:46:15.219ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3912024-11-14T04:46:15.225ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3922024-11-14T04:46:15.225ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3932024-11-14T04:46:15.227ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3942024-11-14T04:46:15.227ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3952024-11-14T04:46:15.229ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3962024-11-14T04:46:15.229ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3972024-11-14T04:46:15.230ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3982024-11-14T04:46:15.230ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3992024-11-14T04:46:15.231ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4002024-11-14T04:46:15.232ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4012024-11-14T04:46:15.233ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4022024-11-14T04:46:15.237ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
4032024-11-14T04:46:15.237ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
4042024-11-14T04:46:15.237ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
4052024-11-14T04:46:15.237ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4062024-11-14T04:46:15.238ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4072024-11-14T04:46:15.238ZDEBGnexus (DataLoader): attempting to create silo users
4082024-11-14T04:46:15.238ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4092024-11-14T04:46:15.238ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4102024-11-14T04:46:15.263ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
4112024-11-14T04:46:15.263ZDEBGnexus (DataLoader): attempting to create silo user role assignments
4122024-11-14T04:46:15.263ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4132024-11-14T04:46:15.263ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4142024-11-14T04:46:15.265ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
4152024-11-14T04:46:15.265ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4162024-11-14T04:46:15.265ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4172024-11-14T04:46:15.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 603fd8b8-0c7b-4b1c-8a37-ccaf594d4b85 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
4182024-11-14T04:46:15.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 603fd8b8-0c7b-4b1c-8a37-ccaf594d4b85 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
4192024-11-14T04:46:15.292ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4202024-11-14T04:46:15.292ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4212024-11-14T04:46:15.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 603fd8b8-0c7b-4b1c-8a37-ccaf594d4b85 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
4222024-11-14T04:46:15.300ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4232024-11-14T04:46:15.300ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4242024-11-14T04:46:15.301ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4252024-11-14T04:46:15.302ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4262024-11-14T04:46:15.302ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4272024-11-14T04:46:15.302ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4282024-11-14T04:46:15.305ZINFOnexus: populate complete file = nexus/src/app/mod.rs:555
4292024-11-14T04:46:15.305ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:564
4302024-11-14T04:46:15.309ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Signaled
4312024-11-14T04:46:15.309ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4322024-11-14T04:46:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4332024-11-14T04:46:15.310ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4342024-11-14T04:46:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4352024-11-14T04:46:15.310ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4362024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4372024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4382024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4392024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4402024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4412024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4422024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4432024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4442024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4452024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4462024-11-14T04:46:15.311ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:36:15.311093390 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4472024-11-14T04:46:15.311ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4482024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4492024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4502024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4512024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4522024-11-14T04:46:15.311ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4532024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4542024-11-14T04:46:15.311ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4552024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4562024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4572024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4582024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4592024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4602024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4612024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4622024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4632024-11-14T04:46:15.311ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4642024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4652024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4662024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4672024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4682024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4692024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4702024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4712024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4722024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4732024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4742024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4752024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4762024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4772024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4782024-11-14T04:46:15.311ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4792024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4802024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4812024-11-14T04:46:15.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4822024-11-14T04:46:15.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 128.113\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4832024-11-14T04:46:15.312ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 88.642\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4842024-11-14T04:46:15.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4852024-11-14T04:46:15.313ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4862024-11-14T04:46:15.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4872024-11-14T04:46:15.313ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4882024-11-14T04:46:15.320ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4892024-11-14T04:46:15.321ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4902024-11-14T04:46:15.321ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4912024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4922024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4932024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4942024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4952024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4962024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4972024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4982024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4992024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5002024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
5012024-11-14T04:46:15.321ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
5022024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 10.055012ms iteration = 1 status = {"error":"no config nor servers"}
5032024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
5042024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5052024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5062024-11-14T04:46:15.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5072024-11-14T04:46:15.322ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 93959668 } })
5082024-11-14T04:46:15.322ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 93818483 } })
5092024-11-14T04:46:15.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5102024-11-14T04:46:15.326ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 15.250991ms iteration = 1 status = {"error":"no blueprint"}
5112024-11-14T04:46:15.326ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5122024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5132024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
5142024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5152024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5162024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5172024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5182024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5192024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5202024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5212024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5222024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5232024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5242024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5252024-11-14T04:46:15.327ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
5262024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 16.378664ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5272024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5282024-11-14T04:46:15.327ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5292024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 23.14\u{b5}s iteration = 2 status = {"error":"no config"}
5302024-11-14T04:46:15.327ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5312024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 16.684644ms iteration = 1 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5322024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5332024-11-14T04:46:15.327ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5342024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 7.48\u{b5}s iteration = 2 status = {"error":"no config"}
5352024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5362024-11-14T04:46:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5372024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5382024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5392024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5402024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5412024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5422024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5432024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5442024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5452024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5462024-11-14T04:46:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5472024-11-14T04:46:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5482024-11-14T04:46:15.329ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5492024-11-14T04:46:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5502024-11-14T04:46:15.336ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-11-14T04:46:15.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5522024-11-14T04:46:15.339ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5532024-11-14T04:46:15.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5542024-11-14T04:46:15.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5552024-11-14T04:46:15.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5562024-11-14T04:46:15.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5572024-11-14T04:46:15.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5582024-11-14T04:46:15.391ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 80.063129ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5592024-11-14T04:46:15.391ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 80.269795ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5602024-11-14T04:46:15.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-11-14T04:46:15.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5622024-11-14T04:46:15.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5632024-11-14T04:46:15.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5642024-11-14T04:46:15.411ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 183682026 } })
5652024-11-14T04:46:15.412ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
5662024-11-14T04:46:15.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-11-14T04:46:15.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 105.346281ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
5682024-11-14T04:46:15.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5692024-11-14T04:46:15.416ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5702024-11-14T04:46:15.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5712024-11-14T04:46:15.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5722024-11-14T04:46:15.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5732024-11-14T04:46:15.436ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5742024-11-14T04:46:15.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5752024-11-14T04:46:15.455ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:36:15.311093390 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5762024-11-14T04:46:15.455ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 144.102764ms iteration = 1 status = {"expiration":"2024-11-14T04:36:15.311093390Z","pruned":[]}
5772024-11-14T04:46:15.461ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
5782024-11-14T04:46:15.461ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5792024-11-14T04:46:15.461ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "540924c4-41ed-4b1c-979c-3a9cf5ec45b3", "content-length": "26", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
5802024-11-14T04:46:15.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5812024-11-14T04:46:15.464ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5822024-11-14T04:46:15.474ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5832024-11-14T04:46:15.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5842024-11-14T04:46:15.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-11-14T04:46:15.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5862024-11-14T04:46:15.478ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5872024-11-14T04:46:15.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5882024-11-14T04:46:15.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5892024-11-14T04:46:15.479ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5902024-11-14T04:46:15.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5912024-11-14T04:46:15.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5922024-11-14T04:46:15.481ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5932024-11-14T04:46:15.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5942024-11-14T04:46:15.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5952024-11-14T04:46:15.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5962024-11-14T04:46:15.488ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 260248153 } })
5972024-11-14T04:46:15.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-11-14T04:46:15.488ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
5992024-11-14T04:46:15.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 178.275683ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
6002024-11-14T04:46:15.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6012024-11-14T04:46:15.491ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6022024-11-14T04:46:15.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6032024-11-14T04:46:15.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6042024-11-14T04:46:15.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6052024-11-14T04:46:15.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6062024-11-14T04:46:15.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6072024-11-14T04:46:15.500ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 189.270601ms iteration = 1 status = {}
6082024-11-14T04:46:15.502ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092024-11-14T04:46:15.503ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6102024-11-14T04:46:15.503ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 192.311229ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6112024-11-14T04:46:15.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6122024-11-14T04:46:15.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6132024-11-14T04:46:15.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6142024-11-14T04:46:15.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6152024-11-14T04:46:15.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6162024-11-14T04:46:15.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6172024-11-14T04:46:15.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6182024-11-14T04:46:15.516ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6192024-11-14T04:46:15.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6202024-11-14T04:46:15.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6212024-11-14T04:46:15.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6222024-11-14T04:46:15.518ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
6232024-11-14T04:46:15.519ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 207.978333ms iteration = 1 status = {"error":"inventory collection is None"}
6242024-11-14T04:46:15.521ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6252024-11-14T04:46:15.525ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec249042-7aaa-40a1-ad8d-f1a6cc7ea79b", "content-length": "1", "date": "Thu, 14 Nov 2024 04:46:14 GMT"} })
6262024-11-14T04:46:15.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6272024-11-14T04:46:15.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6282024-11-14T04:46:15.529ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292024-11-14T04:46:15.530ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6302024-11-14T04:46:15.530ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6312024-11-14T04:46:15.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6322024-11-14T04:46:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6332024-11-14T04:46:15.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6342024-11-14T04:46:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6352024-11-14T04:46:15.534ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6362024-11-14T04:46:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6372024-11-14T04:46:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6382024-11-14T04:46:15.541ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6392024-11-14T04:46:15.541ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
6402024-11-14T04:46:15.541ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 230.258458ms iteration = 1 status = {"error":"rack not yet initialized: f971eb12-0fea-4084-96d3-74198bddd289"}
6412024-11-14T04:46:15.541ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 954, tv_nsec: 313805344 } })
6422024-11-14T04:46:15.544ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6432024-11-14T04:46:15.544ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 233.015248ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6442024-11-14T04:46:15.544ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6452024-11-14T04:46:15.544ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6462024-11-14T04:46:15.545ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5bb6a19-1f38-4dbc-ad1a-97b1175b5513", "content-length": "26", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6472024-11-14T04:46:15.545ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6482024-11-14T04:46:15.546ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6492024-11-14T04:46:15.564ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6502024-11-14T04:46:15.565ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6512024-11-14T04:46:15.565ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6522024-11-14T04:46:15.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6532024-11-14T04:46:15.565ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 254.308584ms iteration = 1 status = null
6542024-11-14T04:46:15.578ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6552024-11-14T04:46:15.578ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 267.61941ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6562024-11-14T04:46:15.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6572024-11-14T04:46:15.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6582024-11-14T04:46:15.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6592024-11-14T04:46:15.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6602024-11-14T04:46:15.604ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6612024-11-14T04:46:15.604ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6622024-11-14T04:46:15.604ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 292.839601ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6632024-11-14T04:46:15.605ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6642024-11-14T04:46:15.605ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6652024-11-14T04:46:15.605ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6662024-11-14T04:46:15.606ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5ff8ded-4521-40c9-8c4b-5a60a67d5c7a", "content-length": "476", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6672024-11-14T04:46:15.608ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6682024-11-14T04:46:15.608ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ba8e20e-df33-46bc-8f03-55e8839d90a4", "content-length": "734", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6692024-11-14T04:46:15.609ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6702024-11-14T04:46:15.609ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6712024-11-14T04:46:15.610ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e94715bd-359c-4e6f-9171-db4bfaa200f9", "content-length": "111", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6722024-11-14T04:46:15.610ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6732024-11-14T04:46:15.610ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2075c051-54b0-4d09-a398-b49cc5cb1cf6", "content-length": "111", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6742024-11-14T04:46:15.611ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6752024-11-14T04:46:15.611ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "073cac57-a949-4eed-91bb-a30970e8f65c", "content-length": "167", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6762024-11-14T04:46:15.611ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6772024-11-14T04:46:15.612ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "129a9c78-797a-459d-81f2-4ee00d4298e4", "content-length": "167", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6782024-11-14T04:46:15.612ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6792024-11-14T04:46:15.612ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f863dc02-dfa5-4bdf-bf04-1d230c0b25a8", "content-length": "175", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6802024-11-14T04:46:15.612ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6812024-11-14T04:46:15.613ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0007750c-22da-4711-b030-16ab7f64b844", "content-length": "175", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6822024-11-14T04:46:15.613ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6832024-11-14T04:46:15.613ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "06cbc6c5-7b5d-4a4f-8beb-bae48039ab5e", "content-length": "702", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6842024-11-14T04:46:15.613ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6852024-11-14T04:46:15.613ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4acbb4c9-7cc6-4069-bbeb-8ca3fa56e518", "content-length": "727", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6862024-11-14T04:46:15.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6872024-11-14T04:46:15.613ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6882024-11-14T04:46:15.613ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6892024-11-14T04:46:15.614ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "322a5e64-c907-4538-8d4a-4c29db1921e3", "content-length": "729", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6902024-11-14T04:46:15.614ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6912024-11-14T04:46:15.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6922024-11-14T04:46:15.614ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "428bebf4-b0d2-4186-be5d-c94193669aa7", "content-length": "728", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6932024-11-14T04:46:15.614ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6942024-11-14T04:46:15.614ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbc05dae-9c8c-4f9b-a023-31418ff4a767", "content-length": "722", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6952024-11-14T04:46:15.614ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6962024-11-14T04:46:15.615ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b702231d-66b1-4742-9aea-2e388aa05e1a", "content-length": "109", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
6972024-11-14T04:46:15.615ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6982024-11-14T04:46:15.615ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6992024-11-14T04:46:15.615ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d061c404-0bc5-49dc-9194-1243cb1fe3a9", "content-length": "109", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7002024-11-14T04:46:15.615ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7012024-11-14T04:46:15.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7022024-11-14T04:46:15.616ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f0cbf9e-7643-4fcd-8eef-089ea46558bf", "content-length": "169", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7032024-11-14T04:46:15.616ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7042024-11-14T04:46:15.617ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de48a39-1dbd-4b99-a217-3532be183060", "content-length": "169", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7052024-11-14T04:46:15.617ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7062024-11-14T04:46:15.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 306.377552ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7072024-11-14T04:46:15.617ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7082024-11-14T04:46:15.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7092024-11-14T04:46:15.618ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "24b650bd-23fc-436b-8f2d-ad4de2285112", "content-length": "178", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7102024-11-14T04:46:15.618ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7112024-11-14T04:46:15.618ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c9f969a-8c40-4b0e-89ad-adff3e491b8e", "content-length": "178", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7122024-11-14T04:46:15.618ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7132024-11-14T04:46:15.618ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3f37b5f-b8d0-4b48-97f4-17d1b802a448", "content-length": "702", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7142024-11-14T04:46:15.618ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7152024-11-14T04:46:15.619ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ce4581-96ce-49a6-8e36-3708227e4642", "content-length": "727", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7162024-11-14T04:46:15.619ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7172024-11-14T04:46:15.620ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182024-11-14T04:46:15.620ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bad0438-a778-4f51-b2ee-482f094b5200", "content-length": "729", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7192024-11-14T04:46:15.620ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7202024-11-14T04:46:15.620ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "42d5237e-0c76-4e12-889b-14b8f6f4b15f", "content-length": "728", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
7212024-11-14T04:46:15.620ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7222024-11-14T04:46:15.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7232024-11-14T04:46:15.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7242024-11-14T04:46:15.624ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7252024-11-14T04:46:15.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7262024-11-14T04:46:15.626ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7272024-11-14T04:46:15.626ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7282024-11-14T04:46:15.626ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 315.418064ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7292024-11-14T04:46:15.628ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 317.751191ms iteration = 1 status = {}
7302024-11-14T04:46:15.630ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312024-11-14T04:46:15.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7322024-11-14T04:46:15.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7332024-11-14T04:46:15.632ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7342024-11-14T04:46:15.632ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7352024-11-14T04:46:15.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7362024-11-14T04:46:15.633ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372024-11-14T04:46:15.634ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7382024-11-14T04:46:15.634ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 322.920281ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7392024-11-14T04:46:15.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7402024-11-14T04:46:15.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7412024-11-14T04:46:15.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7422024-11-14T04:46:15.636ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7432024-11-14T04:46:15.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7442024-11-14T04:46:15.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7452024-11-14T04:46:15.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7462024-11-14T04:46:15.638ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7472024-11-14T04:46:15.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7482024-11-14T04:46:15.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 329.832751ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7492024-11-14T04:46:15.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7502024-11-14T04:46:15.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7512024-11-14T04:46:15.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7522024-11-14T04:46:15.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7532024-11-14T04:46:15.645ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7542024-11-14T04:46:15.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7552024-11-14T04:46:15.647ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7562024-11-14T04:46:15.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7572024-11-14T04:46:15.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582024-11-14T04:46:15.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592024-11-14T04:46:15.656ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7602024-11-14T04:46:15.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7612024-11-14T04:46:15.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-11-14T04:46:15.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-11-14T04:46:15.670ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-11-14T04:46:15.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652024-11-14T04:46:15.671ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
7662024-11-14T04:46:15.671ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 359.969824ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
7672024-11-14T04:46:15.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682024-11-14T04:46:15.673ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
7692024-11-14T04:46:15.673ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 362.414325ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
7702024-11-14T04:46:15.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712024-11-14T04:46:15.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722024-11-14T04:46:15.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732024-11-14T04:46:15.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7742024-11-14T04:46:15.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7752024-11-14T04:46:15.677ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 366.235066ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7762024-11-14T04:46:15.696ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7772024-11-14T04:46:15.696ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7782024-11-14T04:46:15.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7792024-11-14T04:46:15.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7802024-11-14T04:46:15.707ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7812024-11-14T04:46:15.707ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 396.371549ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7822024-11-14T04:46:15.719ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7832024-11-14T04:46:15.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7842024-11-14T04:46:15.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7852024-11-14T04:46:15.727ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7862024-11-14T04:46:15.727ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7872024-11-14T04:46:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7882024-11-14T04:46:15.729ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7892024-11-14T04:46:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7902024-11-14T04:46:15.730ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 418.729206ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7912024-11-14T04:46:15.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7922024-11-14T04:46:15.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7932024-11-14T04:46:15.757ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7942024-11-14T04:46:15.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7952024-11-14T04:46:15.768ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
7962024-11-14T04:46:15.768ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
7972024-11-14T04:46:15.785ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7982024-11-14T04:46:15.785ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7992024-11-14T04:46:15.785ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 474.546802ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8002024-11-14T04:46:15.795ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8012024-11-14T04:46:15.795ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8022024-11-14T04:46:15.797ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0630466f-3f58-437a-994a-857c40c917f3", "content-length": "312", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
8032024-11-14T04:46:15.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8042024-11-14T04:46:15.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8052024-11-14T04:46:15.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8062024-11-14T04:46:15.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8072024-11-14T04:46:15.811ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8082024-11-14T04:46:15.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8092024-11-14T04:46:15.819ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8102024-11-14T04:46:15.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8112024-11-14T04:46:15.820ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8122024-11-14T04:46:15.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8132024-11-14T04:46:15.823ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8142024-11-14T04:46:15.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8152024-11-14T04:46:15.825ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8162024-11-14T04:46:15.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8172024-11-14T04:46:15.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8182024-11-14T04:46:15.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8192024-11-14T04:46:15.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8202024-11-14T04:46:15.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8212024-11-14T04:46:15.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8222024-11-14T04:46:15.830ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8232024-11-14T04:46:15.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8242024-11-14T04:46:15.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8252024-11-14T04:46:15.831ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8262024-11-14T04:46:15.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8272024-11-14T04:46:15.832ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8282024-11-14T04:46:15.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8292024-11-14T04:46:15.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8302024-11-14T04:46:15.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8312024-11-14T04:46:15.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8322024-11-14T04:46:15.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8332024-11-14T04:46:15.872ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8342024-11-14T04:46:15.873ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8352024-11-14T04:46:15.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8362024-11-14T04:46:15.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8372024-11-14T04:46:15.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8382024-11-14T04:46:15.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8392024-11-14T04:46:15.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8402024-11-14T04:46:15.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8412024-11-14T04:46:15.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8422024-11-14T04:46:15.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8432024-11-14T04:46:15.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8442024-11-14T04:46:15.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8452024-11-14T04:46:15.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8462024-11-14T04:46:15.892ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "47ae12fe-fe65-4191-9e85-fedd31f485fe", "content-length": "691", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
8472024-11-14T04:46:15.892ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8482024-11-14T04:46:15.892ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8492024-11-14T04:46:15.892ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8502024-11-14T04:46:15.893ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 582.456617ms iteration = 1 status = {}
8512024-11-14T04:46:15.895ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
8522024-11-14T04:46:15.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8532024-11-14T04:46:15.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8542024-11-14T04:46:15.897ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8552024-11-14T04:46:15.898ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8562024-11-14T04:46:15.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8572024-11-14T04:46:15.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8582024-11-14T04:46:15.906ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8592024-11-14T04:46:15.906ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8602024-11-14T04:46:15.906ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8612024-11-14T04:46:15.939ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8622024-11-14T04:46:15.939ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8632024-11-14T04:46:15.939ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "80be2a32-5c3b-4841-bbe5-fbb316f548cb", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
8642024-11-14T04:46:15.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8652024-11-14T04:46:15.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8662024-11-14T04:46:15.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8672024-11-14T04:46:15.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8682024-11-14T04:46:15.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8692024-11-14T04:46:15.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8702024-11-14T04:46:15.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8712024-11-14T04:46:15.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8722024-11-14T04:46:15.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8732024-11-14T04:46:15.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8742024-11-14T04:46:15.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8752024-11-14T04:46:15.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8762024-11-14T04:46:15.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8772024-11-14T04:46:15.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8782024-11-14T04:46:15.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8792024-11-14T04:46:15.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8802024-11-14T04:46:15.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8812024-11-14T04:46:15.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8822024-11-14T04:46:15.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8832024-11-14T04:46:15.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8842024-11-14T04:46:15.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8852024-11-14T04:46:15.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8862024-11-14T04:46:15.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8872024-11-14T04:46:15.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8882024-11-14T04:46:15.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8892024-11-14T04:46:15.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8902024-11-14T04:46:15.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8912024-11-14T04:46:15.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8922024-11-14T04:46:15.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8932024-11-14T04:46:15.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
8942024-11-14T04:46:15.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8952024-11-14T04:46:15.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8962024-11-14T04:46:15.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8972024-11-14T04:46:15.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8982024-11-14T04:46:15.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8992024-11-14T04:46:15.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9002024-11-14T04:46:15.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9012024-11-14T04:46:15.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9022024-11-14T04:46:16.000ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9032024-11-14T04:46:16.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9042024-11-14T04:46:16.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9052024-11-14T04:46:16.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9062024-11-14T04:46:16.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9072024-11-14T04:46:16.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9082024-11-14T04:46:16.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9092024-11-14T04:46:16.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9102024-11-14T04:46:16.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9112024-11-14T04:46:16.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
9122024-11-14T04:46:16.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9132024-11-14T04:46:16.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9142024-11-14T04:46:16.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9152024-11-14T04:46:16.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9162024-11-14T04:46:16.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9172024-11-14T04:46:16.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9182024-11-14T04:46:16.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9192024-11-14T04:46:16.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9202024-11-14T04:46:16.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9212024-11-14T04:46:16.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9222024-11-14T04:46:16.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9232024-11-14T04:46:16.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9242024-11-14T04:46:16.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9252024-11-14T04:46:16.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9262024-11-14T04:46:16.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9272024-11-14T04:46:16.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
9282024-11-14T04:46:16.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9292024-11-14T04:46:16.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9302024-11-14T04:46:16.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9312024-11-14T04:46:16.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9322024-11-14T04:46:16.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9332024-11-14T04:46:16.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9342024-11-14T04:46:16.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9352024-11-14T04:46:16.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9362024-11-14T04:46:16.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9372024-11-14T04:46:16.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9382024-11-14T04:46:16.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9392024-11-14T04:46:16.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9402024-11-14T04:46:16.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9412024-11-14T04:46:16.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9422024-11-14T04:46:16.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9432024-11-14T04:46:16.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9442024-11-14T04:46:16.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9452024-11-14T04:46:16.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9462024-11-14T04:46:16.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9472024-11-14T04:46:16.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9482024-11-14T04:46:16.048ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9492024-11-14T04:46:16.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9502024-11-14T04:46:16.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9512024-11-14T04:46:16.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9522024-11-14T04:46:16.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9532024-11-14T04:46:16.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9542024-11-14T04:46:16.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9552024-11-14T04:46:16.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9562024-11-14T04:46:16.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9572024-11-14T04:46:16.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9582024-11-14T04:46:16.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9592024-11-14T04:46:16.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
9602024-11-14T04:46:16.065ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9612024-11-14T04:46:16.077ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7beca75d-6622-49ef-86d5-4b4385bb2d2e", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
9622024-11-14T04:46:16.078ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 767.171266ms iteration = 1 status = {}
9632024-11-14T04:46:16.106ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
9642024-11-14T04:46:16.106ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
9652024-11-14T04:46:16.106ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
9662024-11-14T04:46:16.106ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 785.683122ms
9672024-11-14T04:46:16.106ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 795.460895ms iteration = 1 status = {}
9682024-11-14T04:46:16.132ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9692024-11-14T04:46:16.132ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9702024-11-14T04:46:16.134ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9712024-11-14T04:46:16.134ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9722024-11-14T04:46:16.136ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9732024-11-14T04:46:16.138ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f971eb12-0fea-4084-96d3-74198bddd289, lookup_type: ById(f971eb12-0fea-4084-96d3-74198bddd289) } result = Ok(())
9742024-11-14T04:46:16.138ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: f971eb12-0fea-4084-96d3-74198bddd289, time_created: 2024-11-14T04:46:15.187444Z, time_modified: 2024-11-14T04:46:15.187444Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9752024-11-14T04:46:16.232ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bd059ae-cb8a-47fc-8c0c-a21955763396", "content-length": "30744", "date": "Thu, 14 Nov 2024 04:46:15 GMT"} })
9762024-11-14T04:46:16.233ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9772024-11-14T04:46:16.233ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
9782024-11-14T04:46:16.233ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
9792024-11-14T04:46:16.235ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9802024-11-14T04:46:16.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9812024-11-14T04:46:16.236ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9822024-11-14T04:46:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9832024-11-14T04:46:16.238ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9842024-11-14T04:46:16.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9852024-11-14T04:46:16.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 733aef2b-b16e-44a9-834e-d85ecab19e67 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
9862024-11-14T04:46:16.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 733aef2b-b16e-44a9-834e-d85ecab19e67 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
9872024-11-14T04:46:16.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 733aef2b-b16e-44a9-834e-d85ecab19e67 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
9882024-11-14T04:46:16.825ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 4af73f1a-e5f2-4f3a-a815-42b664dfa0ef file = nexus/db-queries/src/db/datastore/inventory.rs:1000
9892024-11-14T04:46:16.825ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 4af73f1a-e5f2-4f3a-a815-42b664dfa0ef time_started = 2024-11-14 04:46:15.604843 UTC
9902024-11-14T04:46:16.825ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.5160097s iteration = 1 status = {"collection_id":"4af73f1a-e5f2-4f3a-a815-42b664dfa0ef","time_done":"2024-11-14 04:46:16.233802 UTC","time_started":"2024-11-14 04:46:15.604843 UTC"}
9912024-11-14T04:46:16.825ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Timeout
9922024-11-14T04:46:16.825ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9932024-11-14T04:46:16.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9942024-11-14T04:46:16.825ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
9952024-11-14T04:46:16.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9962024-11-14T04:46:16.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9972024-11-14T04:46:16.827ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9982024-11-14T04:46:16.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9992024-11-14T04:46:16.829ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10002024-11-14T04:46:16.829ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10012024-11-14T04:46:16.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10022024-11-14T04:46:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10032024-11-14T04:46:16.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10042024-11-14T04:46:16.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10052024-11-14T04:46:16.831ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
10062024-11-14T04:46:16.831ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.326753ms iteration = 2 status = {"error":"rack not yet initialized: f971eb12-0fea-4084-96d3-74198bddd289"}
10072024-11-14T04:46:16.859ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(4af73f1a-e5f2-4f3a-a815-42b664dfa0ef, 0)]
10082024-11-14T04:46:16.859ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 955, tv_nsec: 631668767 } })
10092024-11-14T04:46:16.889ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
10102024-11-14T04:46:16.889ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
10112024-11-14T04:46:16.889ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
10122024-11-14T04:46:16.890ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a45338e-35e2-4a28-b5e8-838739983da1", "content-length": "476", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10132024-11-14T04:46:16.890ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
10142024-11-14T04:46:16.890ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "86aa5f8a-1f3c-4c51-939c-559eb9dea229", "content-length": "734", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10152024-11-14T04:46:16.890ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
10162024-11-14T04:46:16.890ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "044a339c-ec56-4699-bdac-101c1aa71af3", "content-length": "111", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10172024-11-14T04:46:16.890ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
10182024-11-14T04:46:16.891ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b2e1370-6946-4ca9-b1b6-5a483b21d48b", "content-length": "111", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10192024-11-14T04:46:16.891ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
10202024-11-14T04:46:16.891ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "300d93f2-bd49-4fc7-a7d4-37108298519b", "content-length": "167", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10212024-11-14T04:46:16.891ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
10222024-11-14T04:46:16.891ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "135dcb01-0c2f-460d-96ba-7f0d7e72ea4d", "content-length": "167", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10232024-11-14T04:46:16.891ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
10242024-11-14T04:46:16.891ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "972a5879-0d29-4281-8065-886f301508b9", "content-length": "175", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10252024-11-14T04:46:16.891ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
10262024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dab2814-3dad-479d-a069-a8453b8bb3e6", "content-length": "175", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10272024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
10282024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "eafcc17d-a0c3-4e93-a560-6315eb8ecd82", "content-length": "702", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10292024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10302024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "573934a1-538c-4999-84c2-2271a8436fc3", "content-length": "727", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10312024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10322024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "aac65c10-93a4-4469-ad51-8988468682b5", "content-length": "729", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10332024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10342024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa061f74-567d-4a35-b69f-812f1bf43be8", "content-length": "728", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10352024-11-14T04:46:16.892ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
10362024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d486232-1560-4d44-a546-ed2a73235194", "content-length": "722", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10372024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
10382024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "995f1dd5-c965-4836-b3cb-32ece175fe0d", "content-length": "109", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10392024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
10402024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "776d7cf4-0710-4917-8ee8-5fb4dfbdc56d", "content-length": "109", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10412024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
10422024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "04aa2762-ca1f-4a29-bb30-1ac1e5c3e49e", "content-length": "169", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10432024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
10442024-11-14T04:46:16.893ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "38c52e4e-95b7-4ab8-a0ab-843c5d209f9c", "content-length": "169", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10452024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
10462024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc432958-5c3e-415c-b8b9-d6c12f03ecbe", "content-length": "178", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10472024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
10482024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e14330f-635b-4d0c-bc4a-64892fb85d84", "content-length": "178", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10492024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
10502024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3eb92eb1-4c1c-40b4-b9c4-a5c6e66b55e8", "content-length": "702", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10512024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10522024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fb1e073-8d10-49b9-a88a-883b46a2f33c", "content-length": "727", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10532024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10542024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3e96af7-774b-4c7e-a14f-0c932ee7b1d1", "content-length": "729", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10552024-11-14T04:46:16.894ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10562024-11-14T04:46:16.895ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e8b34c2-67a6-4f96-81c9-ee669029713e", "content-length": "728", "date": "Thu, 14 Nov 2024 04:46:16 GMT"} })
10572024-11-14T04:46:16.895ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10582024-11-14T04:46:16.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10592024-11-14T04:46:16.896ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10602024-11-14T04:46:16.898ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10612024-11-14T04:46:16.898ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10622024-11-14T04:46:16.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10632024-11-14T04:46:16.900ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10642024-11-14T04:46:16.901ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10652024-11-14T04:46:16.901ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10662024-11-14T04:46:16.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10672024-11-14T04:46:16.995ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
10682024-11-14T04:46:16.995ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
10692024-11-14T04:46:17.225ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "f28816b0-6a7b-4319-87fa-24af83f43189", "content-length": "30744", "date": "Thu, 14 Nov 2024 04:46:17 GMT"} })
10702024-11-14T04:46:17.227ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10712024-11-14T04:46:17.227ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10722024-11-14T04:46:17.227ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
10732024-11-14T04:46:17.228ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10742024-11-14T04:46:17.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10752024-11-14T04:46:17.230ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10762024-11-14T04:46:17.232ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10772024-11-14T04:46:17.232ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10782024-11-14T04:46:17.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10792024-11-14T04:46:17.319ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 5f2ddd08-a8e8-4775-819d-824daf062f34 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
10802024-11-14T04:46:17.319ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 5f2ddd08-a8e8-4775-819d-824daf062f34 time_started = 2024-11-14 04:46:16.889792 UTC
10812024-11-14T04:46:17.319ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 494.50929ms iteration = 2 status = {"collection_id":"5f2ddd08-a8e8-4775-819d-824daf062f34","time_done":"2024-11-14 04:46:17.227252 UTC","time_started":"2024-11-14 04:46:16.889792 UTC"}
10822024-11-14T04:46:17.319ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
10832024-11-14T04:46:17.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10842024-11-14T04:46:17.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10852024-11-14T04:46:17.321ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10862024-11-14T04:46:17.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10872024-11-14T04:46:17.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10882024-11-14T04:46:17.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10892024-11-14T04:46:17.325ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
10902024-11-14T04:46:17.325ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.807038ms iteration = 3 status = {"error":"rack not yet initialized: f971eb12-0fea-4084-96d3-74198bddd289"}
10912024-11-14T04:46:17.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 19f4b34d-a071-430c-a02d-fa5ce3b48374 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
10922024-11-14T04:46:17.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 19f4b34d-a071-430c-a02d-fa5ce3b48374 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
10932024-11-14T04:46:17.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 19f4b34d-a071-430c-a02d-fa5ce3b48374 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
10942024-11-14T04:46:18.139ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10952024-11-14T04:46:18.139ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10962024-11-14T04:46:18.198ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10972024-11-14T04:46:18.199ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10982024-11-14T04:46:18.200ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10992024-11-14T04:46:18.202ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: f971eb12-0fea-4084-96d3-74198bddd289, lookup_type: ById(f971eb12-0fea-4084-96d3-74198bddd289) } result = Ok(())
11002024-11-14T04:46:18.202ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
11012024-11-14T04:46:18.202ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11022024-11-14T04:46:18.202ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11032024-11-14T04:46:18.204ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11042024-11-14T04:46:18.204ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11052024-11-14T04:46:18.205ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11062024-11-14T04:46:18.205ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11072024-11-14T04:46:18.206ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11082024-11-14T04:46:18.206ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11092024-11-14T04:46:18.207ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11102024-11-14T04:46:18.207ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11112024-11-14T04:46:18.209ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11122024-11-14T04:46:18.209ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11132024-11-14T04:46:18.210ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11142024-11-14T04:46:18.213ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11152024-11-14T04:46:18.213ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11162024-11-14T04:46:18.213ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11172024-11-14T04:46:18.214ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11182024-11-14T04:46:18.214ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11192024-11-14T04:46:18.215ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11202024-11-14T04:46:18.216ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11212024-11-14T04:46:18.216ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11222024-11-14T04:46:18.219ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11232024-11-14T04:46:18.219ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11242024-11-14T04:46:18.220ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11252024-11-14T04:46:18.222ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11262024-11-14T04:46:18.222ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11272024-11-14T04:46:18.223ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11282024-11-14T04:46:18.223ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11292024-11-14T04:46:18.225ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11302024-11-14T04:46:18.225ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11312024-11-14T04:46:18.226ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11322024-11-14T04:46:18.226ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11332024-11-14T04:46:18.227ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11342024-11-14T04:46:18.228ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11352024-11-14T04:46:18.229ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11362024-11-14T04:46:18.229ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11372024-11-14T04:46:18.230ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11382024-11-14T04:46:18.233ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11392024-11-14T04:46:18.233ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11402024-11-14T04:46:18.233ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11412024-11-14T04:46:18.235ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11422024-11-14T04:46:18.235ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11432024-11-14T04:46:18.236ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11442024-11-14T04:46:18.236ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11452024-11-14T04:46:18.238ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11462024-11-14T04:46:18.238ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11472024-11-14T04:46:18.240ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11482024-11-14T04:46:18.240ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11492024-11-14T04:46:18.241ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11502024-11-14T04:46:18.241ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11512024-11-14T04:46:18.242ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11522024-11-14T04:46:18.243ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11532024-11-14T04:46:18.244ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11542024-11-14T04:46:18.247ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11552024-11-14T04:46:18.247ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11562024-11-14T04:46:18.247ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11572024-11-14T04:46:18.249ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11582024-11-14T04:46:18.249ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11592024-11-14T04:46:18.250ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11602024-11-14T04:46:18.250ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11612024-11-14T04:46:18.251ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11622024-11-14T04:46:18.254ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11632024-11-14T04:46:18.254ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11642024-11-14T04:46:18.254ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11652024-11-14T04:46:18.262ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11662024-11-14T04:46:18.263ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11672024-11-14T04:46:18.264ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11682024-11-14T04:46:18.264ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11692024-11-14T04:46:18.265ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11702024-11-14T04:46:18.266ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11712024-11-14T04:46:18.267ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11722024-11-14T04:46:18.268ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11732024-11-14T04:46:18.269ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11742024-11-14T04:46:18.269ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11752024-11-14T04:46:18.271ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11762024-11-14T04:46:18.271ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11772024-11-14T04:46:18.272ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11782024-11-14T04:46:18.272ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11792024-11-14T04:46:18.273ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802024-11-14T04:46:18.276ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11812024-11-14T04:46:18.276ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11822024-11-14T04:46:18.276ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11832024-11-14T04:46:18.277ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11842024-11-14T04:46:18.278ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11852024-11-14T04:46:18.279ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11862024-11-14T04:46:18.279ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11872024-11-14T04:46:18.280ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11882024-11-14T04:46:18.283ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11892024-11-14T04:46:18.283ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11902024-11-14T04:46:18.283ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11912024-11-14T04:46:18.288ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 32de9250-63c9-46be-9a6b-ee4af19ab1ab, kind: Service { id: 48221b8a-d832-4d05-ae47-e92f81388c0c }, name: Name("external-dns-48221b8a-d832-4d05-ae47-e92f81388c0c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 126])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da2f10b4-11b4-4931-a7f7-d415353256ec, kind: Service { id: 8c0d54f6-76b3-47cc-9828-b8e677cc2961 }, name: Name("external-dns-8c0d54f6-76b3-47cc-9828-b8e677cc2961"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 68cb12a7-f65f-4940-ad7a-12ac0e8fa220, kind: Service { id: 7d1b51fe-adf1-4350-9c25-9240054e3911 }, name: Name("nexus-7d1b51fe-adf1-4350-9c25-9240054e3911"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5946ca8-a389-4a86-aed2-97d4e8639c67, kind: Service { id: 13db289d-f9b6-41e9-b3bd-5ab4f3105694 }, name: Name("nexus-13db289d-f9b6-41e9-b3bd-5ab4f3105694"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b897d57d-b436-467c-89e9-441e43e441fa, kind: Service { id: 79994e02-6747-4071-83af-7872b31640fb }, name: Name("nexus-79994e02-6747-4071-83af-7872b31640fb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
11922024-11-14T04:46:18.288ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11932024-11-14T04:46:18.288ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11942024-11-14T04:46:18.290ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952024-11-14T04:46:18.291ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
11962024-11-14T04:46:18.291ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11972024-11-14T04:46:18.291ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11982024-11-14T04:46:18.293ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
11992024-11-14T04:46:18.295ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32de9250-63c9-46be-9a6b-ee4af19ab1ab, kind: Service { id: 48221b8a-d832-4d05-ae47-e92f81388c0c }, name: Name("external-dns-48221b8a-d832-4d05-ae47-e92f81388c0c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 126])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da2f10b4-11b4-4931-a7f7-d415353256ec, kind: Service { id: 8c0d54f6-76b3-47cc-9828-b8e677cc2961 }, name: Name("external-dns-8c0d54f6-76b3-47cc-9828-b8e677cc2961"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 68cb12a7-f65f-4940-ad7a-12ac0e8fa220, kind: Service { id: 7d1b51fe-adf1-4350-9c25-9240054e3911 }, name: Name("nexus-7d1b51fe-adf1-4350-9c25-9240054e3911"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5946ca8-a389-4a86-aed2-97d4e8639c67, kind: Service { id: 13db289d-f9b6-41e9-b3bd-5ab4f3105694 }, name: Name("nexus-13db289d-f9b6-41e9-b3bd-5ab4f3105694"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b897d57d-b436-467c-89e9-441e43e441fa, kind: Service { id: 79994e02-6747-4071-83af-7872b31640fb }, name: Name("nexus-79994e02-6747-4071-83af-7872b31640fb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12002024-11-14T04:46:18.295ZDEBGnexus (InternalApi): resolved 2 rules for sleds
12012024-11-14T04:46:18.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0b5e0ea5-4f32-4f69-bf09-17b92f694471 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12022024-11-14T04:46:18.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0b5e0ea5-4f32-4f69-bf09-17b92f694471 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12032024-11-14T04:46:18.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0b5e0ea5-4f32-4f69-bf09-17b92f694471 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12042024-11-14T04:46:18.727ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: c073d51c-abaa-48df-abb6-2f053e9c1bec, time_created: 2024-11-14T04:46:13.572725Z, time_modified: 2024-11-14T04:46:13.572725Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f971eb12-0fea-4084-96d3-74198bddd289, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
12052024-11-14T04:46:18.727ZDEBGnexus (InternalApi): sending firewall rules to sled agents
12062024-11-14T04:46:18.727ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12072024-11-14T04:46:18.727ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12082024-11-14T04:46:18.729ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12092024-11-14T04:46:18.729ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12102024-11-14T04:46:18.731ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12112024-11-14T04:46:18.733ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
12122024-11-14T04:46:18.763ZDEBGnexus (InternalApi): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12132024-11-14T04:46:18.765ZDEBGnexus (InternalApi): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "bc6f2626-5737-400b-9427-ed8dd024efb9", "date": "Thu, 14 Nov 2024 04:46:18 GMT"} })
12142024-11-14T04:46:18.765ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
12152024-11-14T04:46:18.765ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
12162024-11-14T04:46:19.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e1145f86-ff36-4dda-a2b6-a5b8d2bc4acb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12172024-11-14T04:46:19.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e1145f86-ff36-4dda-a2b6-a5b8d2bc4acb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12182024-11-14T04:46:19.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e1145f86-ff36-4dda-a2b6-a5b8d2bc4acb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12192024-11-14T04:46:20.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a54916f9-495b-4b62-8a13-9228a3a97cea roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12202024-11-14T04:46:20.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a54916f9-495b-4b62-8a13-9228a3a97cea resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12212024-11-14T04:46:20.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a54916f9-495b-4b62-8a13-9228a3a97cea response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12222024-11-14T04:46:21.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f6e765a-7d15-4539-b2f5-5f845116dfe1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12232024-11-14T04:46:21.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f6e765a-7d15-4539-b2f5-5f845116dfe1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12242024-11-14T04:46:21.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f6e765a-7d15-4539-b2f5-5f845116dfe1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12252024-11-14T04:46:22.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 854986fb-6ad9-4e04-8232-aca646cdda2f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12262024-11-14T04:46:22.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 854986fb-6ad9-4e04-8232-aca646cdda2f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12272024-11-14T04:46:22.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 854986fb-6ad9-4e04-8232-aca646cdda2f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12282024-11-14T04:46:23.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7361309b-ee19-4668-812d-42eeb269c7ae roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12292024-11-14T04:46:23.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7361309b-ee19-4668-812d-42eeb269c7ae resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12302024-11-14T04:46:23.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7361309b-ee19-4668-812d-42eeb269c7ae response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12312024-11-14T04:46:24.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 85d02c67-fc16-4a5f-a77b-26206af8a428 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12322024-11-14T04:46:24.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 85d02c67-fc16-4a5f-a77b-26206af8a428 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12332024-11-14T04:46:24.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 85d02c67-fc16-4a5f-a77b-26206af8a428 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12342024-11-14T04:46:25.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
12352024-11-14T04:46:25.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
12362024-11-14T04:46:25.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12372024-11-14T04:46:25.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12382024-11-14T04:46:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12392024-11-14T04:46:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12402024-11-14T04:46:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412024-11-14T04:46:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12422024-11-14T04:46:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12432024-11-14T04:46:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12442024-11-14T04:46:25.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12452024-11-14T04:46:25.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12462024-11-14T04:46:25.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12472024-11-14T04:46:25.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
12482024-11-14T04:46:25.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12492024-11-14T04:46:25.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12502024-11-14T04:46:25.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12512024-11-14T04:46:25.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12522024-11-14T04:46:25.384ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.790837ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12532024-11-14T04:46:25.421ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
12542024-11-14T04:46:25.421ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.82522ms iteration = 2 status = {"enabled":false,"status":"first target blueprint","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z","time_found":"2024-11-14T04:46:25.421687501Z"}
12552024-11-14T04:46:25.421ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
12562024-11-14T04:46:25.421ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
12572024-11-14T04:46:25.421ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
12582024-11-14T04:46:25.421ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.76\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
12592024-11-14T04:46:25.421ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12602024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12612024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12622024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12632024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12642024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12652024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12662024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12672024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12682024-11-14T04:46:25.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12692024-11-14T04:46:25.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12702024-11-14T04:46:25.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12712024-11-14T04:46:25.426ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12722024-11-14T04:46:25.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12732024-11-14T04:46:25.426ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12742024-11-14T04:46:25.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12752024-11-14T04:46:25.428ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12762024-11-14T04:46:25.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12772024-11-14T04:46:25.428ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12782024-11-14T04:46:25.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12792024-11-14T04:46:25.429ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12802024-11-14T04:46:25.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12812024-11-14T04:46:25.430ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822024-11-14T04:46:25.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12832024-11-14T04:46:25.431ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12842024-11-14T04:46:25.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12852024-11-14T04:46:25.431ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12862024-11-14T04:46:25.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12872024-11-14T04:46:25.433ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12882024-11-14T04:46:25.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12892024-11-14T04:46:25.464ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
12902024-11-14T04:46:25.496ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
12912024-11-14T04:46:25.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 39980f2b-4824-466d-9832-ae059cd2e279 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12922024-11-14T04:46:25.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 39980f2b-4824-466d-9832-ae059cd2e279 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12932024-11-14T04:46:25.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 39980f2b-4824-466d-9832-ae059cd2e279 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
12942024-11-14T04:46:25.527ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
12952024-11-14T04:46:25.561ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
12962024-11-14T04:46:25.594ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
12972024-11-14T04:46:26.509ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df079f1c-1f3f-4748-b117-8a28cfd610eb", "content-length": "64", "date": "Thu, 14 Nov 2024 04:46:26 GMT"} })
12982024-11-14T04:46:26.509ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12992024-11-14T04:46:26.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13002024-11-14T04:46:26.511ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13012024-11-14T04:46:26.512ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13022024-11-14T04:46:26.512ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13032024-11-14T04:46:26.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13042024-11-14T04:46:26.532ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "968c647e-60b4-42cc-b94f-9d7df0451c5b", "content-length": "64", "date": "Thu, 14 Nov 2024 04:46:26 GMT"} })
13052024-11-14T04:46:26.532ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13062024-11-14T04:46:26.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13072024-11-14T04:46:26.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082024-11-14T04:46:26.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa9787e0-db41-4a8f-9796-5184e4610d8f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13092024-11-14T04:46:26.535ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13102024-11-14T04:46:26.535ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13112024-11-14T04:46:26.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13122024-11-14T04:46:26.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa9787e0-db41-4a8f-9796-5184e4610d8f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13132024-11-14T04:46:26.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa9787e0-db41-4a8f-9796-5184e4610d8f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13142024-11-14T04:46:26.558ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0634b466-fe40-4828-ae28-9d141cc5d2b6", "content-length": "64", "date": "Thu, 14 Nov 2024 04:46:25 GMT"} })
13152024-11-14T04:46:26.558ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13162024-11-14T04:46:26.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13172024-11-14T04:46:26.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13182024-11-14T04:46:26.561ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13192024-11-14T04:46:26.561ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13202024-11-14T04:46:26.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13212024-11-14T04:46:26.571ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbdac89a-21c3-4ac5-995c-6952dbb5167c", "content-length": "64", "date": "Thu, 14 Nov 2024 04:46:26 GMT"} })
13222024-11-14T04:46:26.571ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13232024-11-14T04:46:26.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13242024-11-14T04:46:26.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13252024-11-14T04:46:26.574ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13262024-11-14T04:46:26.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13272024-11-14T04:46:26.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13282024-11-14T04:46:26.586ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88d3a306-f46b-4c6b-94aa-689bab8bc52b", "content-length": "64", "date": "Thu, 14 Nov 2024 04:46:25 GMT"} })
13292024-11-14T04:46:26.586ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13302024-11-14T04:46:26.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13312024-11-14T04:46:26.587ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322024-11-14T04:46:26.589ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13332024-11-14T04:46:26.589ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13342024-11-14T04:46:26.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13352024-11-14T04:46:26.593ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.172258017s iteration = 2 status = {"nsuccess":5}
13362024-11-14T04:46:27.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df023b4b-c027-49de-b2be-ee9c2ec1c6ea roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13372024-11-14T04:46:27.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df023b4b-c027-49de-b2be-ee9c2ec1c6ea resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13382024-11-14T04:46:27.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df023b4b-c027-49de-b2be-ee9c2ec1c6ea response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13392024-11-14T04:46:28.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f8abe44d-56bd-4463-9329-1bdca19ad7cb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13402024-11-14T04:46:28.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f8abe44d-56bd-4463-9329-1bdca19ad7cb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13412024-11-14T04:46:28.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f8abe44d-56bd-4463-9329-1bdca19ad7cb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13422024-11-14T04:46:29.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80a98582-9499-4460-a264-063782a188ca roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13432024-11-14T04:46:29.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80a98582-9499-4460-a264-063782a188ca resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13442024-11-14T04:46:29.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80a98582-9499-4460-a264-063782a188ca response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13452024-11-14T04:46:30.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94d9806f-3441-439a-81b4-ad6aa60c6e8a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13462024-11-14T04:46:30.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94d9806f-3441-439a-81b4-ad6aa60c6e8a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13472024-11-14T04:46:30.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94d9806f-3441-439a-81b4-ad6aa60c6e8a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13482024-11-14T04:46:31.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e43b28cf-7e66-4492-8a2c-1467755dcc97 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13492024-11-14T04:46:31.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e43b28cf-7e66-4492-8a2c-1467755dcc97 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13502024-11-14T04:46:31.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e43b28cf-7e66-4492-8a2c-1467755dcc97 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13512024-11-14T04:46:32.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a0eb83a4-70d0-4f79-af6b-3a24555207ed roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13522024-11-14T04:46:32.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a0eb83a4-70d0-4f79-af6b-3a24555207ed resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13532024-11-14T04:46:32.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a0eb83a4-70d0-4f79-af6b-3a24555207ed response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13542024-11-14T04:46:33.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 976c8dba-8dd1-47da-9d45-089b5b47418c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13552024-11-14T04:46:33.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 976c8dba-8dd1-47da-9d45-089b5b47418c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13562024-11-14T04:46:33.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 976c8dba-8dd1-47da-9d45-089b5b47418c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13572024-11-14T04:46:34.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c451ef58-f5f5-491c-8da1-9a556bc30bfb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13582024-11-14T04:46:34.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c451ef58-f5f5-491c-8da1-9a556bc30bfb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13592024-11-14T04:46:34.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c451ef58-f5f5-491c-8da1-9a556bc30bfb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13602024-11-14T04:46:35.311ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
13612024-11-14T04:46:35.311ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
13622024-11-14T04:46:35.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13632024-11-14T04:46:35.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13642024-11-14T04:46:35.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13652024-11-14T04:46:35.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13662024-11-14T04:46:35.313ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13672024-11-14T04:46:35.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13682024-11-14T04:46:35.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13692024-11-14T04:46:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13702024-11-14T04:46:35.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13712024-11-14T04:46:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13722024-11-14T04:46:35.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13732024-11-14T04:46:35.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13742024-11-14T04:46:35.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13752024-11-14T04:46:35.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
13762024-11-14T04:46:35.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13772024-11-14T04:46:35.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13782024-11-14T04:46:35.345ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.16835ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13792024-11-14T04:46:35.385ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
13802024-11-14T04:46:35.387ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.430183ms iteration = 3 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
13812024-11-14T04:46:35.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a19a7369-4e40-4116-b746-2e22b86be1f8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13822024-11-14T04:46:35.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a19a7369-4e40-4116-b746-2e22b86be1f8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13832024-11-14T04:46:35.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a19a7369-4e40-4116-b746-2e22b86be1f8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13842024-11-14T04:46:36.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94beca7c-5cd8-43b6-bb6d-8d89e08f6ff6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13852024-11-14T04:46:36.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94beca7c-5cd8-43b6-bb6d-8d89e08f6ff6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13862024-11-14T04:46:36.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94beca7c-5cd8-43b6-bb6d-8d89e08f6ff6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13872024-11-14T04:46:37.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9bb5e35-5928-47ce-99f9-88e0a003ba8a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13882024-11-14T04:46:37.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9bb5e35-5928-47ce-99f9-88e0a003ba8a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13892024-11-14T04:46:37.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9bb5e35-5928-47ce-99f9-88e0a003ba8a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13902024-11-14T04:46:38.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bbb95390-efa6-46e9-aa75-2436e50b1c94 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13912024-11-14T04:46:38.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bbb95390-efa6-46e9-aa75-2436e50b1c94 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13922024-11-14T04:46:38.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bbb95390-efa6-46e9-aa75-2436e50b1c94 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13932024-11-14T04:46:39.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0326b8be-c6f6-47fb-9ec6-3e908afcdc11 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13942024-11-14T04:46:39.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0326b8be-c6f6-47fb-9ec6-3e908afcdc11 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13952024-11-14T04:46:39.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0326b8be-c6f6-47fb-9ec6-3e908afcdc11 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
13962024-11-14T04:46:40.254ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:59723
13972024-11-14T04:46:40.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2befe56d-df20-4416-8104-a16fb32ef773 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
13982024-11-14T04:46:40.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2befe56d-df20-4416-8104-a16fb32ef773 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
13992024-11-14T04:46:40.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2befe56d-df20-4416-8104-a16fb32ef773 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
14002024-11-14T04:46:40.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 68761816-58dd-421e-a498-d8742ae9bc78 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxM2RiMjg5ZC1mOWI2LTQxZTktYjNiZC01YWI0ZjMxMDU2OTQifX0%3D
14012024-11-14T04:46:40.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 68761816-58dd-421e-a498-d8742ae9bc78 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxM2RiMjg5ZC1mOWI2LTQxZTktYjNiZC01YWI0ZjMxMDU2OTQifX0%3D
14022024-11-14T04:46:40.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 68761816-58dd-421e-a498-d8742ae9bc78 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxM2RiMjg5ZC1mOWI2LTQxZTktYjNiZC01YWI0ZjMxMDU2OTQifX0%3D
14032024-11-14T04:46:40.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a4296a8-c140-4d5b-a23b-fc5bfafd338c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14042024-11-14T04:46:40.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a4296a8-c140-4d5b-a23b-fc5bfafd338c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14052024-11-14T04:46:40.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a4296a8-c140-4d5b-a23b-fc5bfafd338c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14062024-11-14T04:46:41.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38afd60d-ecc6-4647-b328-f63610c0b176 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14072024-11-14T04:46:41.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38afd60d-ecc6-4647-b328-f63610c0b176 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14082024-11-14T04:46:41.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38afd60d-ecc6-4647-b328-f63610c0b176 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14092024-11-14T04:46:42.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0439e59c-efac-478f-9e85-62c214c9a399 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14102024-11-14T04:46:42.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0439e59c-efac-478f-9e85-62c214c9a399 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14112024-11-14T04:46:42.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0439e59c-efac-478f-9e85-62c214c9a399 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14122024-11-14T04:46:43.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0684d4ce-135b-4098-b6be-daf0e02b1e2e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14132024-11-14T04:46:43.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0684d4ce-135b-4098-b6be-daf0e02b1e2e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14142024-11-14T04:46:43.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0684d4ce-135b-4098-b6be-daf0e02b1e2e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14152024-11-14T04:46:44.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5917ec51-fe6e-45af-a264-a423742ff941 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14162024-11-14T04:46:44.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5917ec51-fe6e-45af-a264-a423742ff941 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14172024-11-14T04:46:44.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5917ec51-fe6e-45af-a264-a423742ff941 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
14182024-11-14T04:46:45.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 2802610e-4610-4d85-b7ab-b91ae391359e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
14192024-11-14T04:46:45.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 2802610e-4610-4d85-b7ab-b91ae391359e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
14202024-11-14T04:46:45.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 2802610e-4610-4d85-b7ab-b91ae391359e response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
14212024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
14222024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
14232024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14242024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14252024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
14262024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
14272024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
14282024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14292024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
14302024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14312024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14322024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
14332024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
14342024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14352024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14362024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
14372024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
14382024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14392024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
14402024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14412024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14422024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
14432024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
14442024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14452024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14462024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
14472024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14482024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
14492024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14502024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
14512024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14522024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14532024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
14542024-11-14T04:46:45.310ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14552024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14562024-11-14T04:46:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14572024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14582024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14592024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14602024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14612024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14622024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14632024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14642024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14652024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14662024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14672024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14682024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14692024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14702024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14712024-11-14T04:46:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14722024-11-14T04:46:45.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14732024-11-14T04:46:45.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14742024-11-14T04:46:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14752024-11-14T04:46:45.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14762024-11-14T04:46:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14772024-11-14T04:46:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14782024-11-14T04:46:45.317ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14792024-11-14T04:46:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14802024-11-14T04:46:45.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14812024-11-14T04:46:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14822024-11-14T04:46:45.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14832024-11-14T04:46:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14842024-11-14T04:46:45.321ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14852024-11-14T04:46:45.321ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14862024-11-14T04:46:45.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14872024-11-14T04:46:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14882024-11-14T04:46:45.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14892024-11-14T04:46:45.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902024-11-14T04:46:45.325ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 984, tv_nsec: 97236747 } })
14912024-11-14T04:46:45.325ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
14922024-11-14T04:46:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14932024-11-14T04:46:45.325ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14942024-11-14T04:46:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14952024-11-14T04:46:45.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14962024-11-14T04:46:45.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14972024-11-14T04:46:45.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14982024-11-14T04:46:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14992024-11-14T04:46:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15002024-11-14T04:46:45.331ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15012024-11-14T04:46:45.331ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15022024-11-14T04:46:45.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15032024-11-14T04:46:45.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042024-11-14T04:46:45.331ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 984, tv_nsec: 103927661 } })
15052024-11-14T04:46:45.332ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
15062024-11-14T04:46:45.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15072024-11-14T04:46:45.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15082024-11-14T04:46:45.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15092024-11-14T04:46:45.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
15102024-11-14T04:46:45.336ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15112024-11-14T04:46:45.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15122024-11-14T04:46:45.341ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 984, tv_nsec: 113413726 } })
15132024-11-14T04:46:45.341ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
15142024-11-14T04:46:45.362ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15152024-11-14T04:46:45.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15162024-11-14T04:46:45.365ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15172024-11-14T04:46:45.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15182024-11-14T04:46:45.367ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
15192024-11-14T04:46:45.367ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.99937ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
15202024-11-14T04:46:45.371ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15212024-11-14T04:46:45.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15222024-11-14T04:46:45.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15232024-11-14T04:46:45.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 66.016342ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15242024-11-14T04:46:45.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.611509ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
15252024-11-14T04:46:45.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15262024-11-14T04:46:45.379ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15272024-11-14T04:46:45.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15282024-11-14T04:46:45.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15292024-11-14T04:46:45.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15302024-11-14T04:46:45.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.144811ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
15312024-11-14T04:46:45.397ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15322024-11-14T04:46:45.398ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15332024-11-14T04:46:45.398ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15342024-11-14T04:46:45.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15352024-11-14T04:46:45.408ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15362024-11-14T04:46:45.408ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.7333ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15372024-11-14T04:46:45.443ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
15382024-11-14T04:46:45.443ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15392024-11-14T04:46:45.443ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c93715a-401a-47e6-9632-fd5722816961", "content-length": "26", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
15402024-11-14T04:46:45.443ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15412024-11-14T04:46:45.443ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
15422024-11-14T04:46:45.443ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15432024-11-14T04:46:45.444ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3198df99-9f3f-4b5a-b55c-5c31c1163f35", "content-length": "26", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
15442024-11-14T04:46:45.444ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15452024-11-14T04:46:45.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15462024-11-14T04:46:45.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
15472024-11-14T04:46:45.448ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
15482024-11-14T04:46:45.448ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15492024-11-14T04:46:45.449ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e1dcc15-6384-44c1-868c-b05722c4d22e", "content-length": "26", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
15502024-11-14T04:46:45.449ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15512024-11-14T04:46:45.449ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15522024-11-14T04:46:45.449ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15532024-11-14T04:46:45.450ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a27f40c-8e54-4b48-b749-ce7fa8947129", "content-length": "372", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
15542024-11-14T04:46:45.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15552024-11-14T04:46:45.450ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15562024-11-14T04:46:45.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15572024-11-14T04:46:45.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15582024-11-14T04:46:45.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15592024-11-14T04:46:45.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15602024-11-14T04:46:45.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15612024-11-14T04:46:45.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15622024-11-14T04:46:45.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 184.528213ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15632024-11-14T04:46:45.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15642024-11-14T04:46:45.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 186.486781ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15652024-11-14T04:46:45.497ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15662024-11-14T04:46:45.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15672024-11-14T04:46:45.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15682024-11-14T04:46:45.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15692024-11-14T04:46:45.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15702024-11-14T04:46:45.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15712024-11-14T04:46:45.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15722024-11-14T04:46:45.505ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15732024-11-14T04:46:45.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15742024-11-14T04:46:45.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
15752024-11-14T04:46:45.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15762024-11-14T04:46:45.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15772024-11-14T04:46:45.507ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15782024-11-14T04:46:45.507ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15792024-11-14T04:46:45.507ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 196.732067ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15802024-11-14T04:46:45.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15812024-11-14T04:46:45.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15822024-11-14T04:46:45.525ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15832024-11-14T04:46:45.525ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15842024-11-14T04:46:45.526ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cd360cc0-ee60-4dbf-8bba-794b9b8f162e", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
15852024-11-14T04:46:45.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15862024-11-14T04:46:45.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15872024-11-14T04:46:45.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15882024-11-14T04:46:45.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15892024-11-14T04:46:45.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15902024-11-14T04:46:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15912024-11-14T04:46:45.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15922024-11-14T04:46:45.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15932024-11-14T04:46:45.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 228.649122ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15942024-11-14T04:46:45.540ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 984, tv_nsec: 312163302 } })
15952024-11-14T04:46:45.540ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1131
15962024-11-14T04:46:45.545ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15972024-11-14T04:46:45.545ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15982024-11-14T04:46:45.546ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a2215c7a-1163-4fd3-9108-0a87fd866498", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
15992024-11-14T04:46:45.547ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 236.816967ms iteration = 2 status = {}
16002024-11-14T04:46:45.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 242.138802ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16012024-11-14T04:46:45.557ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16022024-11-14T04:46:45.557ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 247.049424ms iteration = 2 status = {}
16032024-11-14T04:46:45.558ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "868d4123-571e-44d6-89fb-7d7a99670c2b", "content-length": "1", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16042024-11-14T04:46:45.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16052024-11-14T04:46:45.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16062024-11-14T04:46:45.562ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 251.880265ms iteration = 2 status = null
16072024-11-14T04:46:45.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16082024-11-14T04:46:45.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16092024-11-14T04:46:45.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16102024-11-14T04:46:45.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16112024-11-14T04:46:45.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16122024-11-14T04:46:45.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16132024-11-14T04:46:45.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16142024-11-14T04:46:45.621ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16152024-11-14T04:46:45.621ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bcde3e8-5ac2-4f4c-a866-ca9da602d9d7", "content-length": "26", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16162024-11-14T04:46:45.621ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16172024-11-14T04:46:45.622ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16182024-11-14T04:46:45.633ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 323.162878ms iteration = 4 status = {"physical_disks_added":0}
16192024-11-14T04:46:45.637ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16202024-11-14T04:46:45.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16212024-11-14T04:46:45.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16222024-11-14T04:46:45.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16232024-11-14T04:46:45.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16242024-11-14T04:46:45.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16252024-11-14T04:46:45.674ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
16262024-11-14T04:46:45.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16272024-11-14T04:46:45.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16282024-11-14T04:46:45.679ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
16292024-11-14T04:46:45.680ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "080b94b5-0902-474a-adfe-84b743a9fe55", "content-length": "4", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16302024-11-14T04:46:45.681ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 371.150778ms iteration = 2 status = 2
16312024-11-14T04:46:45.728ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16322024-11-14T04:46:45.728ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "764c2a0e-ebfe-49a6-ba6c-244b8d72a3b0", "content-length": "691", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16332024-11-14T04:46:45.728ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16342024-11-14T04:46:45.728ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16352024-11-14T04:46:45.728ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16362024-11-14T04:46:45.729ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.926632ms iteration = 2 status = {}
16372024-11-14T04:46:45.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16382024-11-14T04:46:45.752ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d3bfcd4-464c-4b34-ad6a-b03dc160981b", "content-length": "134", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16392024-11-14T04:46:45.752ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16402024-11-14T04:46:45.752ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
16412024-11-14T04:46:45.758ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16422024-11-14T04:46:45.758ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16432024-11-14T04:46:45.758ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16442024-11-14T04:46:45.758ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16452024-11-14T04:46:45.758ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16462024-11-14T04:46:45.758ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16472024-11-14T04:46:45.767ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16482024-11-14T04:46:45.767ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16492024-11-14T04:46:45.769ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
16502024-11-14T04:46:45.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16512024-11-14T04:46:45.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16522024-11-14T04:46:45.776ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16532024-11-14T04:46:45.776ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b8b1f73-f2f1-4dc4-9e2d-1534bae1cece", "content-length": "2", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16542024-11-14T04:46:45.776ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16552024-11-14T04:46:45.777ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "43759725-cfda-422e-bb57-8915c97d9e0a", "content-length": "51", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16562024-11-14T04:46:45.777ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
16572024-11-14T04:46:45.777ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16582024-11-14T04:46:45.921ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "811e6be3-2d4d-4f5e-ab7e-589b53164c5c", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16592024-11-14T04:46:45.921ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
16602024-11-14T04:46:45.921ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16612024-11-14T04:46:45.926ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "087a6702-7ed4-426b-b2b5-5a4f7d9bbc04", "content-length": "539", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16622024-11-14T04:46:45.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16632024-11-14T04:46:45.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16642024-11-14T04:46:45.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16652024-11-14T04:46:45.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16662024-11-14T04:46:45.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aabbd77b-f573-482a-b0db-38f421cbd8db roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16672024-11-14T04:46:45.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aabbd77b-f573-482a-b0db-38f421cbd8db resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16682024-11-14T04:46:45.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aabbd77b-f573-482a-b0db-38f421cbd8db response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16692024-11-14T04:46:46.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16702024-11-14T04:46:46.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16712024-11-14T04:46:46.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16722024-11-14T04:46:46.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16732024-11-14T04:46:46.054ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1230 key = network_key rack_id = f971eb12-0fea-4084-96d3-74198bddd289
16742024-11-14T04:46:46.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16752024-11-14T04:46:46.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16762024-11-14T04:46:46.067ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1287 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
16772024-11-14T04:46:46.068ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16782024-11-14T04:46:46.073ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "7e5a974d-caf6-4a37-9de0-3fff134e6830", "date": "Thu, 14 Nov 2024 04:46:45 GMT"} })
16792024-11-14T04:46:46.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16802024-11-14T04:46:46.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16812024-11-14T04:46:46.087ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 776.359992ms iteration = 2 status = {}
16822024-11-14T04:46:46.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 0b4d473b-e25a-442c-8a96-6d3ecf6759fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
16832024-11-14T04:46:46.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 0b4d473b-e25a-442c-8a96-6d3ecf6759fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
16842024-11-14T04:46:46.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 0b4d473b-e25a-442c-8a96-6d3ecf6759fa response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
16852024-11-14T04:46:46.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 1cbe76c0-9997-4beb-b9cb-f45bc24f09e4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16862024-11-14T04:46:46.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 1cbe76c0-9997-4beb-b9cb-f45bc24f09e4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16872024-11-14T04:46:46.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 1cbe76c0-9997-4beb-b9cb-f45bc24f09e4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16882024-11-14T04:46:46.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38eb0806-a73d-4f31-9d02-9c06b128a009 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16892024-11-14T04:46:46.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38eb0806-a73d-4f31-9d02-9c06b128a009 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16902024-11-14T04:46:46.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38eb0806-a73d-4f31-9d02-9c06b128a009 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16912024-11-14T04:46:47.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d0aca5af-fd33-4918-9085-2b2324ad1f6b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16922024-11-14T04:46:47.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d0aca5af-fd33-4918-9085-2b2324ad1f6b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16932024-11-14T04:46:47.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d0aca5af-fd33-4918-9085-2b2324ad1f6b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16942024-11-14T04:46:49.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 54711f31-bc2b-463f-9e22-ef35cf9c1e66 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16952024-11-14T04:46:49.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 54711f31-bc2b-463f-9e22-ef35cf9c1e66 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16962024-11-14T04:46:49.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 54711f31-bc2b-463f-9e22-ef35cf9c1e66 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16972024-11-14T04:46:50.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87d8eb3d-9f84-4c09-906f-1a807bb83eea roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16982024-11-14T04:46:50.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87d8eb3d-9f84-4c09-906f-1a807bb83eea resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
16992024-11-14T04:46:50.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87d8eb3d-9f84-4c09-906f-1a807bb83eea response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17002024-11-14T04:46:51.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5cf3700-8149-4b7d-a009-9c7be2903af8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17012024-11-14T04:46:51.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5cf3700-8149-4b7d-a009-9c7be2903af8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17022024-11-14T04:46:51.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5cf3700-8149-4b7d-a009-9c7be2903af8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17032024-11-14T04:46:52.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4b1f554b-7ba7-495b-81d9-c82ca52a7c71 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17042024-11-14T04:46:52.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4b1f554b-7ba7-495b-81d9-c82ca52a7c71 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17052024-11-14T04:46:52.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4b1f554b-7ba7-495b-81d9-c82ca52a7c71 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17062024-11-14T04:46:53.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce5672a1-1682-4962-8e27-8e98c43df607 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17072024-11-14T04:46:53.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce5672a1-1682-4962-8e27-8e98c43df607 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17082024-11-14T04:46:53.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce5672a1-1682-4962-8e27-8e98c43df607 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17092024-11-14T04:46:54.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87777b95-7710-4ce9-9e15-07497a507199 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17102024-11-14T04:46:54.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87777b95-7710-4ce9-9e15-07497a507199 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17112024-11-14T04:46:54.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87777b95-7710-4ce9-9e15-07497a507199 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17122024-11-14T04:46:55.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b57f96ab-152a-43ac-be7c-86c1c16dc407 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17132024-11-14T04:46:55.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b57f96ab-152a-43ac-be7c-86c1c16dc407 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17142024-11-14T04:46:55.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b57f96ab-152a-43ac-be7c-86c1c16dc407 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17152024-11-14T04:46:55.311ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
17162024-11-14T04:46:55.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17172024-11-14T04:46:55.311ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
17182024-11-14T04:46:55.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17192024-11-14T04:46:55.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17202024-11-14T04:46:55.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17212024-11-14T04:46:55.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17222024-11-14T04:46:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17232024-11-14T04:46:55.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17242024-11-14T04:46:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17252024-11-14T04:46:55.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17262024-11-14T04:46:55.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17272024-11-14T04:46:55.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17282024-11-14T04:46:55.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
17292024-11-14T04:46:55.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17302024-11-14T04:46:55.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17312024-11-14T04:46:55.341ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
17322024-11-14T04:46:55.341ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.360749ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
17332024-11-14T04:46:55.342ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17342024-11-14T04:46:55.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17352024-11-14T04:46:55.344ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.482029ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17362024-11-14T04:46:56.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b2ec764-4cf9-46b5-bfbf-5b33b58c428a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17372024-11-14T04:46:56.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b2ec764-4cf9-46b5-bfbf-5b33b58c428a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17382024-11-14T04:46:56.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b2ec764-4cf9-46b5-bfbf-5b33b58c428a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17392024-11-14T04:46:57.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2f6a3a72-ffbf-4739-bba3-3a036f765897 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17402024-11-14T04:46:57.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2f6a3a72-ffbf-4739-bba3-3a036f765897 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17412024-11-14T04:46:57.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2f6a3a72-ffbf-4739-bba3-3a036f765897 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17422024-11-14T04:46:58.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bf51d731-236a-4d09-abb3-242087206147 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17432024-11-14T04:46:58.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bf51d731-236a-4d09-abb3-242087206147 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17442024-11-14T04:46:58.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bf51d731-236a-4d09-abb3-242087206147 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17452024-11-14T04:46:59.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8651764-ca32-4c8f-a2d2-c6a9229e3c18 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17462024-11-14T04:46:59.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8651764-ca32-4c8f-a2d2-c6a9229e3c18 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17472024-11-14T04:46:59.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8651764-ca32-4c8f-a2d2-c6a9229e3c18 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17482024-11-14T04:47:00.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d93c244-68df-4370-8fcd-4241f43cf1d3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17492024-11-14T04:47:00.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d93c244-68df-4370-8fcd-4241f43cf1d3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17502024-11-14T04:47:00.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d93c244-68df-4370-8fcd-4241f43cf1d3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17512024-11-14T04:47:01.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04b00c32-9768-4cce-a2f9-c204ef4b72a3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17522024-11-14T04:47:01.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04b00c32-9768-4cce-a2f9-c204ef4b72a3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17532024-11-14T04:47:01.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04b00c32-9768-4cce-a2f9-c204ef4b72a3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17542024-11-14T04:47:02.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d4281440-09f1-43cc-a965-095104213e8d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17552024-11-14T04:47:02.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d4281440-09f1-43cc-a965-095104213e8d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17562024-11-14T04:47:02.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d4281440-09f1-43cc-a965-095104213e8d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17572024-11-14T04:47:03.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f480c59-e29b-4924-8283-e81cfa68a18b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17582024-11-14T04:47:03.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f480c59-e29b-4924-8283-e81cfa68a18b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17592024-11-14T04:47:03.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f480c59-e29b-4924-8283-e81cfa68a18b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17602024-11-14T04:47:04.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc8a1867-ec10-4d12-b435-f792e60437bb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17612024-11-14T04:47:04.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc8a1867-ec10-4d12-b435-f792e60437bb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17622024-11-14T04:47:04.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc8a1867-ec10-4d12-b435-f792e60437bb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17632024-11-14T04:47:05.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
17642024-11-14T04:47:05.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
17652024-11-14T04:47:05.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17662024-11-14T04:47:05.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17672024-11-14T04:47:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17682024-11-14T04:47:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17692024-11-14T04:47:05.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17702024-11-14T04:47:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17712024-11-14T04:47:05.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17722024-11-14T04:47:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17732024-11-14T04:47:05.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17742024-11-14T04:47:05.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17752024-11-14T04:47:05.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17762024-11-14T04:47:05.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
17772024-11-14T04:47:05.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17782024-11-14T04:47:05.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17792024-11-14T04:47:05.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
17802024-11-14T04:47:05.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.527185ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
17812024-11-14T04:47:05.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 42e70e71-05ef-498f-ad22-5b77dac9b225 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17822024-11-14T04:47:05.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 42e70e71-05ef-498f-ad22-5b77dac9b225 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17832024-11-14T04:47:05.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 42e70e71-05ef-498f-ad22-5b77dac9b225 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17842024-11-14T04:47:05.340ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17852024-11-14T04:47:05.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17862024-11-14T04:47:05.368ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.267728ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17872024-11-14T04:47:06.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = adb0ed5d-37db-465f-ab0a-7e8c446b107a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17882024-11-14T04:47:06.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = adb0ed5d-37db-465f-ab0a-7e8c446b107a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17892024-11-14T04:47:06.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = adb0ed5d-37db-465f-ab0a-7e8c446b107a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17902024-11-14T04:47:07.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7486c9f1-d437-4ff7-8963-cbe857678b4d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17912024-11-14T04:47:07.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7486c9f1-d437-4ff7-8963-cbe857678b4d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17922024-11-14T04:47:07.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7486c9f1-d437-4ff7-8963-cbe857678b4d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17932024-11-14T04:47:08.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0df9cee-cdab-415f-8794-46bcbf3f58cd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17942024-11-14T04:47:08.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0df9cee-cdab-415f-8794-46bcbf3f58cd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17952024-11-14T04:47:08.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0df9cee-cdab-415f-8794-46bcbf3f58cd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17962024-11-14T04:47:09.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f02a08d8-e3e2-41de-b271-c7d176c33727 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17972024-11-14T04:47:09.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f02a08d8-e3e2-41de-b271-c7d176c33727 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17982024-11-14T04:47:09.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f02a08d8-e3e2-41de-b271-c7d176c33727 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
17992024-11-14T04:47:10.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0cb96ec-a6f0-4b8a-bf8c-e28645a0a6ad roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18002024-11-14T04:47:10.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0cb96ec-a6f0-4b8a-bf8c-e28645a0a6ad resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18012024-11-14T04:47:10.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0cb96ec-a6f0-4b8a-bf8c-e28645a0a6ad response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18022024-11-14T04:47:11.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c039f26-20fc-48fe-9ac7-57dde6f053a6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18032024-11-14T04:47:11.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c039f26-20fc-48fe-9ac7-57dde6f053a6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18042024-11-14T04:47:11.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c039f26-20fc-48fe-9ac7-57dde6f053a6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18052024-11-14T04:47:12.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8191bfce-c735-46fc-a6bb-ab50fbf8fe7d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18062024-11-14T04:47:12.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8191bfce-c735-46fc-a6bb-ab50fbf8fe7d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18072024-11-14T04:47:12.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8191bfce-c735-46fc-a6bb-ab50fbf8fe7d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18082024-11-14T04:47:13.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5764f87b-33a8-4635-b1a4-c1b15e3d1e28 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18092024-11-14T04:47:13.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5764f87b-33a8-4635-b1a4-c1b15e3d1e28 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18102024-11-14T04:47:13.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5764f87b-33a8-4635-b1a4-c1b15e3d1e28 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18112024-11-14T04:47:14.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0bbcc14e-689f-4f95-ba2c-11847a658928 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18122024-11-14T04:47:14.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0bbcc14e-689f-4f95-ba2c-11847a658928 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18132024-11-14T04:47:14.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0bbcc14e-689f-4f95-ba2c-11847a658928 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
18142024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
18152024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18162024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
18172024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18182024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
18192024-11-14T04:47:15.311ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
18202024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
18212024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 14.42\u{b5}s iteration = 3 status = {"error":"no config"}
18222024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
18232024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18242024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
18252024-11-14T04:47:15.311ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
18262024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18272024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
18282024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.77\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
18292024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
18302024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18312024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
18322024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18332024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
18342024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
18352024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18362024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
18372024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18382024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
18392024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
18402024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18412024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
18422024-11-14T04:47:15.311ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:37:15.311354954 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18432024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18442024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18452024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
18462024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18472024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
18482024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
18492024-11-14T04:47:15.311ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18502024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18512024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
18522024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18532024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18542024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
18552024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18562024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18572024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
18582024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18592024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
18602024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
18612024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18622024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
18632024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
18642024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18652024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18662024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18672024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
18682024-11-14T04:47:15.311ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
18692024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.37\u{b5}s iteration = 3 status = {"error":"no config"}
18702024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
18712024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18722024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18732024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
18742024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18752024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
18762024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
18772024-11-14T04:47:15.311ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18782024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18792024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18802024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18812024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18822024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18832024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18842024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18852024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18862024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18872024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18882024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18892024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18902024-11-14T04:47:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18912024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18922024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18932024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18942024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18952024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18962024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18972024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18982024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18992024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19002024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19012024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19022024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19032024-11-14T04:47:15.312ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 84021711 } })
19042024-11-14T04:47:15.312ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 84034091 } })
19052024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19062024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
19072024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.177234ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
19082024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
19092024-11-14T04:47:15.312ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.460393ms iteration = 2 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
19102024-11-14T04:47:15.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.640036ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
19112024-11-14T04:47:15.314ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.43186ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19122024-11-14T04:47:15.315ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19132024-11-14T04:47:15.315ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 87539773 } })
19142024-11-14T04:47:15.315ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 87642326 } })
19152024-11-14T04:47:15.315ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
19162024-11-14T04:47:15.315ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
19172024-11-14T04:47:15.316ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19182024-11-14T04:47:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19192024-11-14T04:47:15.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19202024-11-14T04:47:15.317ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19212024-11-14T04:47:15.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19222024-11-14T04:47:15.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19232024-11-14T04:47:15.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19242024-11-14T04:47:15.319ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.265549ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
19252024-11-14T04:47:15.320ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:37:15.311354954 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19262024-11-14T04:47:15.320ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.595698ms iteration = 2 status = {"expiration":"2024-11-14T04:37:15.311354954Z","pruned":[]}
19272024-11-14T04:47:15.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282024-11-14T04:47:15.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19292024-11-14T04:47:15.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19302024-11-14T04:47:15.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19312024-11-14T04:47:15.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19322024-11-14T04:47:15.326ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19332024-11-14T04:47:15.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19342024-11-14T04:47:15.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
19352024-11-14T04:47:15.330ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19362024-11-14T04:47:15.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19372024-11-14T04:47:15.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19382024-11-14T04:47:15.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19392024-11-14T04:47:15.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19402024-11-14T04:47:15.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19412024-11-14T04:47:15.337ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19422024-11-14T04:47:15.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19432024-11-14T04:47:15.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19442024-11-14T04:47:15.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19452024-11-14T04:47:15.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.673383ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
19462024-11-14T04:47:15.379ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19472024-11-14T04:47:15.379ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19482024-11-14T04:47:15.380ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "93b043bc-34c9-4371-ab1c-5365f9a2a765", "content-length": "26", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
19492024-11-14T04:47:15.380ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19502024-11-14T04:47:15.384ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19512024-11-14T04:47:15.386ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19522024-11-14T04:47:15.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19532024-11-14T04:47:15.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19542024-11-14T04:47:15.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19552024-11-14T04:47:15.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19562024-11-14T04:47:15.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19572024-11-14T04:47:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19582024-11-14T04:47:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19592024-11-14T04:47:15.395ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19602024-11-14T04:47:15.395ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19612024-11-14T04:47:15.395ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 84.539798ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19622024-11-14T04:47:15.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19632024-11-14T04:47:15.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19642024-11-14T04:47:15.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19652024-11-14T04:47:15.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19662024-11-14T04:47:15.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19672024-11-14T04:47:15.399ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19682024-11-14T04:47:15.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19692024-11-14T04:47:15.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19702024-11-14T04:47:15.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19712024-11-14T04:47:15.400ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19722024-11-14T04:47:15.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19732024-11-14T04:47:15.402ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19742024-11-14T04:47:15.402ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19752024-11-14T04:47:15.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19762024-11-14T04:47:15.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.559171ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19772024-11-14T04:47:15.402ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19782024-11-14T04:47:15.402ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e016e12f-3f79-42a8-90ff-f297f305d02a", "content-length": "26", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
19792024-11-14T04:47:15.402ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19802024-11-14T04:47:15.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19812024-11-14T04:47:15.403ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19822024-11-14T04:47:15.403ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19832024-11-14T04:47:15.403ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19842024-11-14T04:47:15.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19852024-11-14T04:47:15.404ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19862024-11-14T04:47:15.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.635291ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19872024-11-14T04:47:15.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19882024-11-14T04:47:15.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19892024-11-14T04:47:15.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19902024-11-14T04:47:15.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19912024-11-14T04:47:15.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19922024-11-14T04:47:15.408ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1014, tv_nsec: 180293519 } })
19932024-11-14T04:47:15.408ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
19942024-11-14T04:47:15.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19952024-11-14T04:47:15.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19962024-11-14T04:47:15.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19972024-11-14T04:47:15.411ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19982024-11-14T04:47:15.411ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19992024-11-14T04:47:15.411ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.256263ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20002024-11-14T04:47:15.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.540272ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
20012024-11-14T04:47:15.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20022024-11-14T04:47:15.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20032024-11-14T04:47:15.418ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20042024-11-14T04:47:15.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20052024-11-14T04:47:15.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20062024-11-14T04:47:15.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20072024-11-14T04:47:15.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20082024-11-14T04:47:15.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20092024-11-14T04:47:15.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20102024-11-14T04:47:15.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20112024-11-14T04:47:15.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20122024-11-14T04:47:15.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.230979ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20132024-11-14T04:47:15.425ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20142024-11-14T04:47:15.425ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20152024-11-14T04:47:15.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20162024-11-14T04:47:15.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20172024-11-14T04:47:15.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20182024-11-14T04:47:15.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
20192024-11-14T04:47:15.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20202024-11-14T04:47:15.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20212024-11-14T04:47:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20222024-11-14T04:47:15.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20232024-11-14T04:47:15.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20242024-11-14T04:47:15.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
20252024-11-14T04:47:15.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 152.558627ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
20262024-11-14T04:47:15.485ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20272024-11-14T04:47:15.486ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20282024-11-14T04:47:15.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20292024-11-14T04:47:15.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20302024-11-14T04:47:15.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20312024-11-14T04:47:15.493ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20322024-11-14T04:47:15.493ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 181.717272ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20332024-11-14T04:47:15.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20342024-11-14T04:47:15.493ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20352024-11-14T04:47:15.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20362024-11-14T04:47:15.495ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20372024-11-14T04:47:15.495ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20382024-11-14T04:47:15.495ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20392024-11-14T04:47:15.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20402024-11-14T04:47:15.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20412024-11-14T04:47:15.517ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20422024-11-14T04:47:15.517ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20432024-11-14T04:47:15.517ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 205.691427ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20442024-11-14T04:47:15.522ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20452024-11-14T04:47:15.522ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20462024-11-14T04:47:15.522ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20472024-11-14T04:47:15.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20482024-11-14T04:47:15.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20492024-11-14T04:47:15.530ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20502024-11-14T04:47:15.531ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a8f288b-0462-42d3-8a9c-a08fb6c8cf32", "content-length": "1", "date": "Thu, 14 Nov 2024 04:47:14 GMT"} })
20512024-11-14T04:47:15.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20522024-11-14T04:47:15.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20532024-11-14T04:47:15.535ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 224.229864ms iteration = 3 status = null
20542024-11-14T04:47:15.548ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552024-11-14T04:47:15.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20562024-11-14T04:47:15.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20572024-11-14T04:47:15.550ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 239.702232ms iteration = 3 status = {}
20582024-11-14T04:47:15.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
20592024-11-14T04:47:15.551ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20602024-11-14T04:47:15.551ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50d69add-94ab-4b2a-bec1-b3010878e059", "content-length": "26", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
20612024-11-14T04:47:15.551ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20622024-11-14T04:47:15.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dbd6e11-4b91-4b1e-a0c2-6b6709b5971e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
20632024-11-14T04:47:15.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dbd6e11-4b91-4b1e-a0c2-6b6709b5971e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
20642024-11-14T04:47:15.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20652024-11-14T04:47:15.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20662024-11-14T04:47:15.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20672024-11-14T04:47:15.552ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
20682024-11-14T04:47:15.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dbd6e11-4b91-4b1e-a0c2-6b6709b5971e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
20692024-11-14T04:47:15.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20702024-11-14T04:47:15.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20712024-11-14T04:47:15.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20722024-11-14T04:47:15.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20732024-11-14T04:47:15.577ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20742024-11-14T04:47:15.577ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
20752024-11-14T04:47:15.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20762024-11-14T04:47:15.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20772024-11-14T04:47:15.586ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
20782024-11-14T04:47:15.586ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 275.021775ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20792024-11-14T04:47:15.598ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20802024-11-14T04:47:15.598ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20812024-11-14T04:47:15.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20822024-11-14T04:47:15.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20832024-11-14T04:47:15.606ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 295.182077ms iteration = 5 status = {"physical_disks_added":0}
20842024-11-14T04:47:15.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20852024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
20862024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
20872024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
20882024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
20892024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
20902024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
20912024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
20922024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
20932024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
20942024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
20952024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
20962024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
20972024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
20982024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
20992024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
21002024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
21012024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
21022024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
21032024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
21042024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
21052024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
21062024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
21072024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
21082024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
21092024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
21102024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
21112024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
21122024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
21132024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
21142024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
21152024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
21162024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
21172024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
21182024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
21192024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
21202024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
21212024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
21222024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
21232024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
21242024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
21252024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
21262024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
21272024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
21282024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
21292024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
21302024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
21312024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
21322024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
21332024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
21342024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
21352024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
21362024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
21372024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
21382024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
21392024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
21402024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
21412024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
21422024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
21432024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
21442024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
21452024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
21462024-11-14T04:47:15.621ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21472024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21482024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
21492024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
21502024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
21512024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
21522024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
21532024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
21542024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
21552024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
21562024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
21572024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
21582024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
21592024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
21602024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
21612024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
21622024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
21632024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
21642024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
21652024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
21662024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
21672024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
21682024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
21692024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
21702024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
21712024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
21722024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
21732024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
21742024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
21752024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
21762024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
21772024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
21782024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
21792024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
21802024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
21812024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
21822024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
21832024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
21842024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
21852024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
21862024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
21872024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
21882024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
21892024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
21902024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
21912024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
21922024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
21932024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
21942024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
21952024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
21962024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
21972024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
21982024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
21992024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
22002024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
22012024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
22022024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
22032024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
22042024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
22052024-11-14T04:47:15.622ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
22062024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
22072024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
22082024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
22092024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
22102024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
22112024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
22122024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
22132024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
22142024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
22152024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
22162024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
22172024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
22182024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
22192024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
22202024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
22212024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
22222024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
22232024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
22242024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
22252024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
22262024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
22272024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22282024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22292024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
22302024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
22312024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
22322024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
22332024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
22342024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
22352024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
22362024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
22372024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
22382024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
22392024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
22402024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
22412024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
22422024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
22432024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
22442024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
22452024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
22462024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
22472024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
22482024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
22492024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
22502024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
22512024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
22522024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
22532024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
22542024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
22552024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
22562024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
22572024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
22582024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
22592024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
22602024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
22612024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
22622024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
22632024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
22642024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
22652024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
22662024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
22672024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
22682024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
22692024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
22702024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
22712024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
22722024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
22732024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
22742024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
22752024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
22762024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
22772024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
22782024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
22792024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
22802024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
22812024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
22822024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
22832024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
22842024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
22852024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
22862024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
22872024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
22882024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
22892024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
22902024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
22912024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
22922024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
22932024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
22942024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
22952024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
22962024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
22972024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
22982024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
22992024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
23002024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
23012024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
23022024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
23032024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
23042024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
23052024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
23062024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
23072024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
23082024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
23092024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
23102024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
23112024-11-14T04:47:15.624ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
23122024-11-14T04:47:15.624ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
23132024-11-14T04:47:15.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23142024-11-14T04:47:15.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23152024-11-14T04:47:15.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23162024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
23172024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
23182024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
23192024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
23202024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
23212024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
23222024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
23232024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
23242024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
23252024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
23262024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
23272024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
23282024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
23292024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
23302024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
23312024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
23322024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
23332024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
23342024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
23352024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
23362024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
23372024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
23382024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
23392024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
23402024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
23412024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
23422024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
23432024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
23442024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
23452024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
23462024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
23472024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
23482024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
23492024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
23502024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
23512024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
23522024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
23532024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
23542024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
23552024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
23562024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
23572024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
23582024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
23592024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
23602024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
23612024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
23622024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
23632024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
23642024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
23652024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
23662024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
23672024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
23682024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
23692024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
23702024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
23712024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
23722024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
23732024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
23742024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
23752024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
23762024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
23772024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23782024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23792024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
23802024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
23812024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
23822024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
23832024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
23842024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
23852024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
23862024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
23872024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
23882024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
23892024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
23902024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
23912024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
23922024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
23932024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
23942024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
23952024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
23962024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
23972024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
23982024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
23992024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
24002024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
24012024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
24022024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
24032024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
24042024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
24052024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
24062024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
24072024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
24082024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
24092024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
24102024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
24112024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
24122024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
24132024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
24142024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
24152024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
24162024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
24172024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
24182024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
24192024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
24202024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
24212024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
24222024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
24232024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
24242024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
24252024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
24262024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
24272024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
24282024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
24292024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
24302024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
24312024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
24322024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
24332024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
24342024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
24352024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
24362024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
24372024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
24382024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
24392024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
24402024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
24412024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
24422024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
24432024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
24442024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
24452024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
24462024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
24472024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
24482024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
24492024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
24502024-11-14T04:47:15.631ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
24512024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
24522024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
24532024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
24542024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
24552024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
24562024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
24572024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
24582024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24592024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
24602024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
24612024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
24622024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
24632024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
24642024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
24652024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
24662024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
24672024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
24682024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
24692024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
24702024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
24712024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
24722024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
24732024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
24742024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
24752024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
24762024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
24772024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
24782024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
24792024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
24802024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
24812024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
24822024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
24832024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
24842024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
24852024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
24862024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
24872024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
24882024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
24892024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
24902024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
24912024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
24922024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
24932024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
24942024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
24952024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
24962024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
24972024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
24982024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
24992024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
25002024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
25012024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
25022024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
25032024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
25042024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
25052024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
25062024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
25072024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
25082024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
25092024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
25102024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
25112024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
25122024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
25132024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
25142024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
25152024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
25162024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
25172024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
25182024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
25192024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
25202024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
25212024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
25222024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
25232024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
25242024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
25252024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
25262024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
25272024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
25282024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
25292024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
25302024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
25312024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
25322024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
25332024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
25342024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
25352024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
25362024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
25372024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
25382024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
25392024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
25402024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
25412024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
25422024-11-14T04:47:15.632ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
25432024-11-14T04:47:15.632ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
25442024-11-14T04:47:15.632ZDEBGnexus (nexus-producer-server): registered DTrace probes
25452024-11-14T04:47:15.640ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25462024-11-14T04:47:15.640ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 329.054769ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25472024-11-14T04:47:15.641ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:61320 method = GET path = /{producer_id} versions = all
25482024-11-14T04:47:15.642ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:61320
25492024-11-14T04:47:15.642ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:61320
25502024-11-14T04:47:15.642ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:61320
25512024-11-14T04:47:15.642ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
25522024-11-14T04:47:15.642ZDEBGnexus (nexus-producer-server): starting producer registration task
25532024-11-14T04:47:15.642ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:61320 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 79994e02-6747-4071-83af-7872b31640fb
25542024-11-14T04:47:15.642ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
25552024-11-14T04:47:15.642ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
25562024-11-14T04:47:15.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25572024-11-14T04:47:15.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25582024-11-14T04:47:15.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25592024-11-14T04:47:15.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25602024-11-14T04:47:15.684ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25612024-11-14T04:47:15.684ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25622024-11-14T04:47:15.684ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a13442ba-0cc3-44a4-84d2-cfbfbae8d217", "content-length": "372", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
25632024-11-14T04:47:15.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25642024-11-14T04:47:15.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25652024-11-14T04:47:15.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662024-11-14T04:47:15.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25672024-11-14T04:47:15.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25682024-11-14T04:47:15.688ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
25692024-11-14T04:47:15.688ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25702024-11-14T04:47:15.688ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
25712024-11-14T04:47:15.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 377.382859ms iteration = 2 status = {"generation":2}
25722024-11-14T04:47:15.688ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
25732024-11-14T04:47:15.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25742024-11-14T04:47:15.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25752024-11-14T04:47:15.689ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25762024-11-14T04:47:15.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25772024-11-14T04:47:15.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25782024-11-14T04:47:15.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25792024-11-14T04:47:15.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25802024-11-14T04:47:15.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25812024-11-14T04:47:15.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25822024-11-14T04:47:15.696ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
25832024-11-14T04:47:15.696ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25842024-11-14T04:47:15.696ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
25852024-11-14T04:47:15.696ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 385.472163ms iteration = 2 status = {"generation":1}
25862024-11-14T04:47:15.696ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
25872024-11-14T04:47:15.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25882024-11-14T04:47:15.698ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25892024-11-14T04:47:15.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25902024-11-14T04:47:15.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
25912024-11-14T04:47:15.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25922024-11-14T04:47:15.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25932024-11-14T04:47:15.701ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 390.165259ms iteration = 3 status = 0
25942024-11-14T04:47:15.707ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25952024-11-14T04:47:15.707ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25962024-11-14T04:47:15.707ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9cfff26b-1b2c-46b1-b490-9c85544c97c0", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
25972024-11-14T04:47:15.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25982024-11-14T04:47:15.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25992024-11-14T04:47:15.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26002024-11-14T04:47:15.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26012024-11-14T04:47:15.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26022024-11-14T04:47:15.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26032024-11-14T04:47:15.718ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26042024-11-14T04:47:15.718ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26052024-11-14T04:47:15.718ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f8755c53-c19b-413e-8e93-307e5ab52011", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
26062024-11-14T04:47:15.720ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 408.683465ms iteration = 3 status = {}
26072024-11-14T04:47:15.747ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
26082024-11-14T04:47:15.747ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:37042
26092024-11-14T04:47:15.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37042 req_id = 8116c137-52ef-4904-b1bb-335138c3db36 roles = RoleSet { roles: {} } uri = /metrics/producers
26102024-11-14T04:47:15.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37042 req_id = 8116c137-52ef-4904-b1bb-335138c3db36 resource = Database result = Ok(()) uri = /metrics/producers
26112024-11-14T04:47:15.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26122024-11-14T04:47:15.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26132024-11-14T04:47:15.789ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26142024-11-14T04:47:15.795ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26152024-11-14T04:47:15.796ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26162024-11-14T04:47:15.796ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ac8b172-7380-4a25-a04a-cecca390d474", "content-length": "691", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
26172024-11-14T04:47:15.796ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26182024-11-14T04:47:15.796ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26192024-11-14T04:47:15.796ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26202024-11-14T04:47:15.798ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 486.57822ms iteration = 3 status = {}
26212024-11-14T04:47:15.805ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
26222024-11-14T04:47:15.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26232024-11-14T04:47:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26242024-11-14T04:47:15.833ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26252024-11-14T04:47:15.833ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3607b8b8-8259-4c53-b70c-9963459beb4c", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26262024-11-14T04:47:15.833ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26272024-11-14T04:47:15.835ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b4e47471-9d7e-4f27-b916-eed50573bc2b", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26282024-11-14T04:47:15.835ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26292024-11-14T04:47:15.837ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26302024-11-14T04:47:15.837ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 148.215851ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26312024-11-14T04:47:15.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26322024-11-14T04:47:15.845ZINFOnexus: assigned collector to new producer collector_id = 459b411b-9021-43ae-8875-254e55794157 file = nexus/src/app/oximeter.rs:76 producer_id = 79994e02-6747-4071-83af-7872b31640fb
26332024-11-14T04:47:15.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98664 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37042 req_id = 8116c137-52ef-4904-b1bb-335138c3db36 response_code = 201 uri = /metrics/producers
26342024-11-14T04:47:15.846ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8116c137-52ef-4904-b1bb-335138c3db36", "content-length": "41", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
26352024-11-14T04:47:15.847ZDEBGnexus (producer-registration-task): registered with nexus successfully
26362024-11-14T04:47:15.847ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
26372024-11-14T04:47:15.871ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26382024-11-14T04:47:15.872ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fe55bfda-1d86-4459-a52b-c83318c1e769", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26392024-11-14T04:47:15.872ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26402024-11-14T04:47:15.873ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2ca2c966-5144-412b-b3a9-f841e93e6b19", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26412024-11-14T04:47:15.873ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26422024-11-14T04:47:15.875ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "76d14dc4-b56d-4177-9846-2cbb880b1d07", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26432024-11-14T04:47:15.875ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26442024-11-14T04:47:15.876ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26452024-11-14T04:47:15.876ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
26462024-11-14T04:47:15.876ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 179.732614ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26472024-11-14T04:47:15.876ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ffae1d6-733f-40d8-bc3e-c316972256bf", "content-length": "134", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
26482024-11-14T04:47:15.876ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26492024-11-14T04:47:15.876ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
26502024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26512024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26522024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26532024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26542024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26552024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26562024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26572024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26582024-11-14T04:47:15.877ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
26592024-11-14T04:47:15.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26602024-11-14T04:47:15.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26612024-11-14T04:47:15.880ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26622024-11-14T04:47:15.880ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b0b1cc1-c0b5-4084-83f2-c0917c6213db", "content-length": "2", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
26632024-11-14T04:47:15.880ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26642024-11-14T04:47:15.880ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c938272-7b51-4ea2-93a9-f0a9721b010c", "content-length": "51", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
26652024-11-14T04:47:15.880ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
26662024-11-14T04:47:15.880ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26672024-11-14T04:47:15.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "351e92f9-c453-4fab-9994-2210482b3f83", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
26682024-11-14T04:47:15.974ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
26692024-11-14T04:47:15.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26702024-11-14T04:47:15.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bf301af-f766-4596-8d9c-850446f2b22f", "content-length": "682", "date": "Thu, 14 Nov 2024 04:47:15 GMT"} })
26712024-11-14T04:47:15.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26722024-11-14T04:47:15.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26732024-11-14T04:47:15.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26742024-11-14T04:47:15.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26752024-11-14T04:47:15.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26762024-11-14T04:47:15.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26772024-11-14T04:47:15.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26782024-11-14T04:47:15.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26792024-11-14T04:47:16.110ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 798.687809ms iteration = 3 status = {}
26802024-11-14T04:47:16.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = a1c4b930-3c95-443f-a236-e82da1d6b093 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26812024-11-14T04:47:16.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = a1c4b930-3c95-443f-a236-e82da1d6b093 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26822024-11-14T04:47:16.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = a1c4b930-3c95-443f-a236-e82da1d6b093 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26832024-11-14T04:47:16.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1ed46e29-3dd6-4f4e-9524-e6abc7b72571 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26842024-11-14T04:47:16.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1ed46e29-3dd6-4f4e-9524-e6abc7b72571 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26852024-11-14T04:47:16.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1ed46e29-3dd6-4f4e-9524-e6abc7b72571 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26862024-11-14T04:47:17.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 34145a25-8293-408b-9fb4-e836e4db7142 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26872024-11-14T04:47:17.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 34145a25-8293-408b-9fb4-e836e4db7142 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26882024-11-14T04:47:17.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 34145a25-8293-408b-9fb4-e836e4db7142 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26892024-11-14T04:47:18.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f33d287a-8a0e-4abf-a421-402982bd4f7a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26902024-11-14T04:47:18.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f33d287a-8a0e-4abf-a421-402982bd4f7a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26912024-11-14T04:47:18.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f33d287a-8a0e-4abf-a421-402982bd4f7a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26922024-11-14T04:47:19.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5777d10-69d3-4160-b55d-e2d2ae25d11d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26932024-11-14T04:47:19.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5777d10-69d3-4160-b55d-e2d2ae25d11d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26942024-11-14T04:47:19.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5777d10-69d3-4160-b55d-e2d2ae25d11d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26952024-11-14T04:47:20.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 57a3635b-a51d-4595-ac41-b2e6a6dca6a0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26962024-11-14T04:47:20.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 57a3635b-a51d-4595-ac41-b2e6a6dca6a0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26972024-11-14T04:47:20.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 57a3635b-a51d-4595-ac41-b2e6a6dca6a0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26982024-11-14T04:47:21.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = acea3cc5-d7ac-4480-97a5-80bcdc798e70 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
26992024-11-14T04:47:21.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = acea3cc5-d7ac-4480-97a5-80bcdc798e70 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27002024-11-14T04:47:21.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = acea3cc5-d7ac-4480-97a5-80bcdc798e70 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27012024-11-14T04:47:22.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e333a64-60e9-4770-ba96-cc03bdfa0f83 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27022024-11-14T04:47:22.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e333a64-60e9-4770-ba96-cc03bdfa0f83 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27032024-11-14T04:47:22.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e333a64-60e9-4770-ba96-cc03bdfa0f83 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27042024-11-14T04:47:23.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea83ea78-3e1e-42f7-8f6d-2a5fdcd79e7a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27052024-11-14T04:47:23.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea83ea78-3e1e-42f7-8f6d-2a5fdcd79e7a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27062024-11-14T04:47:23.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea83ea78-3e1e-42f7-8f6d-2a5fdcd79e7a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27072024-11-14T04:47:24.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f934fe7-f634-49fa-a984-19392bedb8c0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27082024-11-14T04:47:24.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f934fe7-f634-49fa-a984-19392bedb8c0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27092024-11-14T04:47:24.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f934fe7-f634-49fa-a984-19392bedb8c0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27102024-11-14T04:47:25.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
27112024-11-14T04:47:25.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27122024-11-14T04:47:25.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
27132024-11-14T04:47:25.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27142024-11-14T04:47:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27152024-11-14T04:47:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27162024-11-14T04:47:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27172024-11-14T04:47:25.313ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27182024-11-14T04:47:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27192024-11-14T04:47:25.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.870102ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27202024-11-14T04:47:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27212024-11-14T04:47:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27222024-11-14T04:47:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27232024-11-14T04:47:25.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27242024-11-14T04:47:25.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27252024-11-14T04:47:25.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27262024-11-14T04:47:25.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
27272024-11-14T04:47:25.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27282024-11-14T04:47:25.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27292024-11-14T04:47:25.387ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:61320 remote_addr = [fd00:1122:3344:101::d]:62170
27302024-11-14T04:47:25.395ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7753 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 9abb7696-c3e5-4098-91a3-b61d2cdbfba3 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
27312024-11-14T04:47:25.432ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
27322024-11-14T04:47:25.432ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 122.032884ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
27332024-11-14T04:47:25.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eb634fdb-a44d-4b83-84b7-b610b4fa6fb1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27342024-11-14T04:47:25.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eb634fdb-a44d-4b83-84b7-b610b4fa6fb1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27352024-11-14T04:47:25.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eb634fdb-a44d-4b83-84b7-b610b4fa6fb1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27362024-11-14T04:47:26.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ac8032d9-408f-488b-819a-045a962961ed roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27372024-11-14T04:47:26.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ac8032d9-408f-488b-819a-045a962961ed resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27382024-11-14T04:47:26.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ac8032d9-408f-488b-819a-045a962961ed response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27392024-11-14T04:47:27.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 157432f8-af85-4fee-b60b-fb3df8f09b09 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27402024-11-14T04:47:27.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 157432f8-af85-4fee-b60b-fb3df8f09b09 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27412024-11-14T04:47:27.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 157432f8-af85-4fee-b60b-fb3df8f09b09 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27422024-11-14T04:47:28.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6de92cd6-9722-4598-8737-b1f19db308e4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27432024-11-14T04:47:28.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6de92cd6-9722-4598-8737-b1f19db308e4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27442024-11-14T04:47:28.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6de92cd6-9722-4598-8737-b1f19db308e4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27452024-11-14T04:47:29.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32d3000a-b081-4c6f-ac36-07e053d6bbe8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27462024-11-14T04:47:29.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32d3000a-b081-4c6f-ac36-07e053d6bbe8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27472024-11-14T04:47:29.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32d3000a-b081-4c6f-ac36-07e053d6bbe8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27482024-11-14T04:47:30.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0a0c35bf-a585-4b0c-81f3-cadfee273e0e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27492024-11-14T04:47:30.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0a0c35bf-a585-4b0c-81f3-cadfee273e0e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27502024-11-14T04:47:30.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0a0c35bf-a585-4b0c-81f3-cadfee273e0e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27512024-11-14T04:47:31.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0766a904-1995-4297-8c5d-6a2d3403a088 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27522024-11-14T04:47:31.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0766a904-1995-4297-8c5d-6a2d3403a088 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27532024-11-14T04:47:31.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0766a904-1995-4297-8c5d-6a2d3403a088 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27542024-11-14T04:47:32.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d03aa138-fd7e-447c-b99e-b40966277c68 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27552024-11-14T04:47:32.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d03aa138-fd7e-447c-b99e-b40966277c68 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27562024-11-14T04:47:32.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d03aa138-fd7e-447c-b99e-b40966277c68 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27572024-11-14T04:47:33.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 283584e6-c061-4cc5-a873-ec720707b167 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27582024-11-14T04:47:33.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 283584e6-c061-4cc5-a873-ec720707b167 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27592024-11-14T04:47:33.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 283584e6-c061-4cc5-a873-ec720707b167 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27602024-11-14T04:47:34.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 88a9e8d7-4fcd-4964-8791-40274d89ca61 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27612024-11-14T04:47:34.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 88a9e8d7-4fcd-4964-8791-40274d89ca61 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27622024-11-14T04:47:34.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 88a9e8d7-4fcd-4964-8791-40274d89ca61 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27632024-11-14T04:47:35.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
27642024-11-14T04:47:35.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27652024-11-14T04:47:35.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
27662024-11-14T04:47:35.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27672024-11-14T04:47:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27682024-11-14T04:47:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27692024-11-14T04:47:35.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27702024-11-14T04:47:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27712024-11-14T04:47:35.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27722024-11-14T04:47:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27732024-11-14T04:47:35.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27742024-11-14T04:47:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27752024-11-14T04:47:35.343ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.963025ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27762024-11-14T04:47:35.344ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27772024-11-14T04:47:35.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27782024-11-14T04:47:35.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27792024-11-14T04:47:35.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
27802024-11-14T04:47:35.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27812024-11-14T04:47:35.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27822024-11-14T04:47:35.359ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
27832024-11-14T04:47:35.359ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.017229ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
27842024-11-14T04:47:35.388ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 602 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 114540a7-8969-48e8-a20c-e6a13c21a5ea response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
27852024-11-14T04:47:35.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9ce14f5-e807-4016-8789-11a0c278a369 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27862024-11-14T04:47:35.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9ce14f5-e807-4016-8789-11a0c278a369 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27872024-11-14T04:47:36.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9ce14f5-e807-4016-8789-11a0c278a369 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27882024-11-14T04:47:37.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8c0aaf93-5a83-47bd-87b1-0e31bf1567cc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27892024-11-14T04:47:37.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8c0aaf93-5a83-47bd-87b1-0e31bf1567cc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27902024-11-14T04:47:37.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8c0aaf93-5a83-47bd-87b1-0e31bf1567cc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27912024-11-14T04:47:38.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a1af1894-62b7-45b0-b521-467d12c9f25f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27922024-11-14T04:47:38.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a1af1894-62b7-45b0-b521-467d12c9f25f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27932024-11-14T04:47:38.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a1af1894-62b7-45b0-b521-467d12c9f25f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27942024-11-14T04:47:39.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7678ebcc-b3fc-4649-85d5-e112001ce02e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27952024-11-14T04:47:39.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7678ebcc-b3fc-4649-85d5-e112001ce02e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27962024-11-14T04:47:39.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7678ebcc-b3fc-4649-85d5-e112001ce02e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27972024-11-14T04:47:40.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c7cdeb4b-6888-4c8f-a06b-06108c397716 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27982024-11-14T04:47:40.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c7cdeb4b-6888-4c8f-a06b-06108c397716 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
27992024-11-14T04:47:40.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c7cdeb4b-6888-4c8f-a06b-06108c397716 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28002024-11-14T04:47:41.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15c8db7c-f6f1-40f5-8727-3ae4d05882a2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28012024-11-14T04:47:41.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15c8db7c-f6f1-40f5-8727-3ae4d05882a2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28022024-11-14T04:47:41.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15c8db7c-f6f1-40f5-8727-3ae4d05882a2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28032024-11-14T04:47:42.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3ea3e59a-73f4-4c70-82e4-079e475ed2bf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28042024-11-14T04:47:42.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3ea3e59a-73f4-4c70-82e4-079e475ed2bf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28052024-11-14T04:47:42.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3ea3e59a-73f4-4c70-82e4-079e475ed2bf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28062024-11-14T04:47:43.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c09f625-493c-4a4b-9eca-b29f5da13589 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28072024-11-14T04:47:43.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c09f625-493c-4a4b-9eca-b29f5da13589 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28082024-11-14T04:47:43.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c09f625-493c-4a4b-9eca-b29f5da13589 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28092024-11-14T04:47:44.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51e562f2-dd6d-46d9-a8b6-565e47e4ae76 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28102024-11-14T04:47:44.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51e562f2-dd6d-46d9-a8b6-565e47e4ae76 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28112024-11-14T04:47:44.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51e562f2-dd6d-46d9-a8b6-565e47e4ae76 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28122024-11-14T04:47:45.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56ba4deb-58f4-4b70-9798-5b2669c8ea29 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28132024-11-14T04:47:45.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56ba4deb-58f4-4b70-9798-5b2669c8ea29 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28142024-11-14T04:47:45.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56ba4deb-58f4-4b70-9798-5b2669c8ea29 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
28152024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
28162024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
28172024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28182024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28192024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
28202024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
28212024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28222024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
28232024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28242024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
28252024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
28262024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28272024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28282024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28292024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
28302024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28312024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
28322024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
28332024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28342024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28352024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
28362024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28372024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
28382024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
28392024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28402024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28412024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
28422024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28432024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
28442024-11-14T04:47:45.310ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28452024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
28462024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28472024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28482024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
28492024-11-14T04:47:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28502024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28512024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28522024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28532024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28542024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28552024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28562024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28572024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28582024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28592024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28602024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28612024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28622024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28632024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28642024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28652024-11-14T04:47:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28662024-11-14T04:47:45.313ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1044, tv_nsec: 85936262 } })
28672024-11-14T04:47:45.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28682024-11-14T04:47:45.314ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
28692024-11-14T04:47:45.314ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28702024-11-14T04:47:45.314ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.007105ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28712024-11-14T04:47:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28722024-11-14T04:47:45.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28732024-11-14T04:47:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28742024-11-14T04:47:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28752024-11-14T04:47:45.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28762024-11-14T04:47:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28772024-11-14T04:47:45.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28782024-11-14T04:47:45.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28792024-11-14T04:47:45.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28802024-11-14T04:47:45.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28812024-11-14T04:47:45.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28822024-11-14T04:47:45.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28832024-11-14T04:47:45.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28842024-11-14T04:47:45.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28852024-11-14T04:47:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28862024-11-14T04:47:45.325ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28872024-11-14T04:47:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28882024-11-14T04:47:45.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28892024-11-14T04:47:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28902024-11-14T04:47:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28912024-11-14T04:47:45.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28922024-11-14T04:47:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28932024-11-14T04:47:45.328ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28942024-11-14T04:47:45.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28952024-11-14T04:47:45.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28962024-11-14T04:47:45.331ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28972024-11-14T04:47:45.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28982024-11-14T04:47:45.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28992024-11-14T04:47:45.334ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29002024-11-14T04:47:45.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29012024-11-14T04:47:45.335ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1044, tv_nsec: 107397553 } })
29022024-11-14T04:47:45.335ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
29032024-11-14T04:47:45.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29042024-11-14T04:47:45.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29052024-11-14T04:47:45.338ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29062024-11-14T04:47:45.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
29072024-11-14T04:47:45.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29082024-11-14T04:47:45.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29092024-11-14T04:47:45.352ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
29102024-11-14T04:47:45.352ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.027717ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
29112024-11-14T04:47:45.359ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29122024-11-14T04:47:45.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29132024-11-14T04:47:45.366ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29142024-11-14T04:47:45.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29152024-11-14T04:47:45.369ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29162024-11-14T04:47:45.369ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29172024-11-14T04:47:45.369ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29182024-11-14T04:47:45.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29192024-11-14T04:47:45.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.954564ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
29202024-11-14T04:47:45.378ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29212024-11-14T04:47:45.378ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.447542ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
29222024-11-14T04:47:45.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29232024-11-14T04:47:45.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29242024-11-14T04:47:45.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29252024-11-14T04:47:45.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29262024-11-14T04:47:45.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29272024-11-14T04:47:45.404ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
29282024-11-14T04:47:45.404ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29292024-11-14T04:47:45.404ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c35efec3-9cbf-47f5-8c12-8db48243758b", "content-length": "26", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
29302024-11-14T04:47:45.404ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29312024-11-14T04:47:45.407ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29322024-11-14T04:47:45.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29332024-11-14T04:47:45.409ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29342024-11-14T04:47:45.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29352024-11-14T04:47:45.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29362024-11-14T04:47:45.410ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29372024-11-14T04:47:45.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29382024-11-14T04:47:45.413ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29392024-11-14T04:47:45.413ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 102.805797ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29402024-11-14T04:47:45.423ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1044, tv_nsec: 195772362 } })
29412024-11-14T04:47:45.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
29422024-11-14T04:47:45.510ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29432024-11-14T04:47:45.510ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a6d9b5e-1e88-4e89-bbca-092c8c375540", "content-length": "1", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
29442024-11-14T04:47:45.513ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29452024-11-14T04:47:45.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29462024-11-14T04:47:45.518ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
29472024-11-14T04:47:45.518ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29482024-11-14T04:47:45.518ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f45c2e01-925f-4d29-bfb1-3422041c67ab", "content-length": "26", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
29492024-11-14T04:47:45.518ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29502024-11-14T04:47:45.520ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
29512024-11-14T04:47:45.538ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
29522024-11-14T04:47:45.539ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29532024-11-14T04:47:45.539ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1faf40e3-a94d-4dc7-94e9-166ce0109a78", "content-length": "372", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
29542024-11-14T04:47:45.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29552024-11-14T04:47:45.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29562024-11-14T04:47:45.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29572024-11-14T04:47:45.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
29582024-11-14T04:47:45.541ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29592024-11-14T04:47:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29602024-11-14T04:47:45.541ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3df43326-1355-47ec-8331-e854e3a0e200", "content-length": "26", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
29612024-11-14T04:47:45.541ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29622024-11-14T04:47:45.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29632024-11-14T04:47:45.543ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29642024-11-14T04:47:45.543ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29652024-11-14T04:47:45.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29662024-11-14T04:47:45.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29672024-11-14T04:47:45.545ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 234.733798ms iteration = 4 status = null
29682024-11-14T04:47:45.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 258.442865ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29692024-11-14T04:47:45.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 261.539044ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29702024-11-14T04:47:45.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29712024-11-14T04:47:45.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29722024-11-14T04:47:45.574ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29732024-11-14T04:47:45.574ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29742024-11-14T04:47:45.574ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 264.457708ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29752024-11-14T04:47:45.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 277.397653ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29762024-11-14T04:47:45.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29772024-11-14T04:47:45.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
29782024-11-14T04:47:45.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29792024-11-14T04:47:45.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29802024-11-14T04:47:45.596ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 285.753015ms iteration = 4 status = 0
29812024-11-14T04:47:45.611ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 301.104349ms iteration = 4 status = {}
29822024-11-14T04:47:45.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 312.274503ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29832024-11-14T04:47:45.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29842024-11-14T04:47:45.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29852024-11-14T04:47:45.667ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 356.834263ms iteration = 6 status = {"physical_disks_added":0}
29862024-11-14T04:47:45.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29872024-11-14T04:47:45.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29882024-11-14T04:47:45.682ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
29892024-11-14T04:47:45.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29902024-11-14T04:47:45.682ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29912024-11-14T04:47:45.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29922024-11-14T04:47:45.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29932024-11-14T04:47:45.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29942024-11-14T04:47:45.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29952024-11-14T04:47:45.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29962024-11-14T04:47:45.688ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29972024-11-14T04:47:45.688ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29982024-11-14T04:47:45.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29992024-11-14T04:47:45.689ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
30002024-11-14T04:47:45.689ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30012024-11-14T04:47:45.693ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30022024-11-14T04:47:45.693ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fe193a5-197d-404a-928d-53ee0bb2136b", "content-length": "134", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
30032024-11-14T04:47:45.693ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30042024-11-14T04:47:45.693ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
30052024-11-14T04:47:45.693ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30062024-11-14T04:47:45.693ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30072024-11-14T04:47:45.693ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30082024-11-14T04:47:45.693ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30092024-11-14T04:47:45.693ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30102024-11-14T04:47:45.693ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30112024-11-14T04:47:45.694ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30122024-11-14T04:47:45.694ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30132024-11-14T04:47:45.694ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
30142024-11-14T04:47:45.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30152024-11-14T04:47:45.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30162024-11-14T04:47:45.704ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30172024-11-14T04:47:45.705ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1502a9a0-60ea-43c3-a627-873ba142900c", "content-length": "2", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
30182024-11-14T04:47:45.705ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30192024-11-14T04:47:45.705ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "25e9a2c3-8a2b-488b-acee-f88550c3d685", "content-length": "51", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
30202024-11-14T04:47:45.705ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
30212024-11-14T04:47:45.705ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30222024-11-14T04:47:45.722ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30232024-11-14T04:47:45.757ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "64ba63dc-8bc1-4a6f-b554-b0f4975eb1a9", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
30242024-11-14T04:47:45.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30252024-11-14T04:47:45.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30262024-11-14T04:47:45.758ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "47f8660d-d0f3-465f-b494-07697eacc0a8", "content-length": "691", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
30272024-11-14T04:47:45.758ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30282024-11-14T04:47:45.758ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30292024-11-14T04:47:45.758ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30302024-11-14T04:47:45.759ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 449.196888ms iteration = 4 status = {}
30312024-11-14T04:47:45.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30322024-11-14T04:47:45.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30332024-11-14T04:47:45.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30342024-11-14T04:47:45.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30352024-11-14T04:47:45.769ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30362024-11-14T04:47:45.769ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30372024-11-14T04:47:45.769ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "35eae9f3-f993-4afc-bd41-9863bdf474dc", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
30382024-11-14T04:47:45.771ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 460.65828ms iteration = 4 status = {}
30392024-11-14T04:47:45.856ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "38336c47-5a18-4976-818a-b5efc2eb1b4f", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
30402024-11-14T04:47:45.857ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
30412024-11-14T04:47:45.857ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30422024-11-14T04:47:45.857ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "624897e6-c2a7-495b-ade1-b16c22d58cf9", "content-length": "682", "date": "Thu, 14 Nov 2024 04:47:45 GMT"} })
30432024-11-14T04:47:45.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30442024-11-14T04:47:45.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30452024-11-14T04:47:45.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30462024-11-14T04:47:45.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30472024-11-14T04:47:45.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30482024-11-14T04:47:45.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30492024-11-14T04:47:45.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30502024-11-14T04:47:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30512024-11-14T04:47:45.973ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 662.596357ms iteration = 4 status = {}
30522024-11-14T04:47:46.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 152d8d20-fbec-4007-8449-d34780992b83 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30532024-11-14T04:47:46.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 152d8d20-fbec-4007-8449-d34780992b83 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30542024-11-14T04:47:46.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 152d8d20-fbec-4007-8449-d34780992b83 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30552024-11-14T04:47:46.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f0287c62-9c7b-49ab-9b1d-7f9356b89b52 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
30562024-11-14T04:47:46.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f0287c62-9c7b-49ab-9b1d-7f9356b89b52 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
30572024-11-14T04:47:46.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f0287c62-9c7b-49ab-9b1d-7f9356b89b52 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
30582024-11-14T04:47:47.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8b5d14e4-b126-4048-a17b-480956f16abf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30592024-11-14T04:47:47.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8b5d14e4-b126-4048-a17b-480956f16abf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30602024-11-14T04:47:47.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8b5d14e4-b126-4048-a17b-480956f16abf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30612024-11-14T04:47:48.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c382a2b8-cb42-46e3-a64a-591cf2570029 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30622024-11-14T04:47:48.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c382a2b8-cb42-46e3-a64a-591cf2570029 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30632024-11-14T04:47:48.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c382a2b8-cb42-46e3-a64a-591cf2570029 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30642024-11-14T04:47:49.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51dd2eec-2959-4336-8453-239971b6dabd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30652024-11-14T04:47:49.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51dd2eec-2959-4336-8453-239971b6dabd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30662024-11-14T04:47:49.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51dd2eec-2959-4336-8453-239971b6dabd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30672024-11-14T04:47:50.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0dec0746-1e2b-425c-9e51-01215f251507 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30682024-11-14T04:47:50.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0dec0746-1e2b-425c-9e51-01215f251507 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30692024-11-14T04:47:50.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0dec0746-1e2b-425c-9e51-01215f251507 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30702024-11-14T04:47:50.354ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 762 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 7cb9b75c-2d0d-4395-a512-5d198ee511b1 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
30712024-11-14T04:47:51.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 28d5d657-2241-4f0b-bfdc-16e18690bdc4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30722024-11-14T04:47:51.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 28d5d657-2241-4f0b-bfdc-16e18690bdc4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30732024-11-14T04:47:51.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 28d5d657-2241-4f0b-bfdc-16e18690bdc4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30742024-11-14T04:47:52.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 109f0f5e-9ed9-4126-bbc4-46caff279224 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30752024-11-14T04:47:52.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 109f0f5e-9ed9-4126-bbc4-46caff279224 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30762024-11-14T04:47:52.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 109f0f5e-9ed9-4126-bbc4-46caff279224 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30772024-11-14T04:47:53.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83e8fa32-f5c6-41ee-8361-ec94060d90da roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30782024-11-14T04:47:53.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83e8fa32-f5c6-41ee-8361-ec94060d90da resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30792024-11-14T04:47:53.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83e8fa32-f5c6-41ee-8361-ec94060d90da response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30802024-11-14T04:47:54.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 71072f76-db1c-492d-8aff-e3e44c3e8b51 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30812024-11-14T04:47:54.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 71072f76-db1c-492d-8aff-e3e44c3e8b51 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30822024-11-14T04:47:54.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 71072f76-db1c-492d-8aff-e3e44c3e8b51 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
30832024-11-14T04:47:55.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 8fe936d2-9c96-4d6e-ab82-fad9d82b3b31 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
30842024-11-14T04:47:55.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 8fe936d2-9c96-4d6e-ab82-fad9d82b3b31 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
30852024-11-14T04:47:55.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 8fe936d2-9c96-4d6e-ab82-fad9d82b3b31 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
30862024-11-14T04:47:55.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 3decbaa2-d6e4-45a7-8217-85e331f05769 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
30872024-11-14T04:47:55.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 3decbaa2-d6e4-45a7-8217-85e331f05769 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
30882024-11-14T04:47:55.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 3decbaa2-d6e4-45a7-8217-85e331f05769 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
30892024-11-14T04:47:55.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
30902024-11-14T04:47:55.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30912024-11-14T04:47:55.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
30922024-11-14T04:47:55.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30932024-11-14T04:47:55.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30942024-11-14T04:47:55.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30952024-11-14T04:47:55.315ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30962024-11-14T04:47:55.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30972024-11-14T04:47:55.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30982024-11-14T04:47:55.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.908829ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30992024-11-14T04:47:55.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31002024-11-14T04:47:55.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31012024-11-14T04:47:55.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31022024-11-14T04:47:55.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31032024-11-14T04:47:55.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31042024-11-14T04:47:55.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31052024-11-14T04:47:55.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
31062024-11-14T04:47:55.323ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31072024-11-14T04:47:55.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31082024-11-14T04:47:55.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75940cba-870a-4479-bf7a-fab8c5d18162 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31092024-11-14T04:47:55.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75940cba-870a-4479-bf7a-fab8c5d18162 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31102024-11-14T04:47:55.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75940cba-870a-4479-bf7a-fab8c5d18162 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31112024-11-14T04:47:55.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
31122024-11-14T04:47:55.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.89177ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
31132024-11-14T04:47:56.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b83f5621-13b1-4e2e-b363-01acfa91d1a1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31142024-11-14T04:47:56.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b83f5621-13b1-4e2e-b363-01acfa91d1a1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31152024-11-14T04:47:56.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b83f5621-13b1-4e2e-b363-01acfa91d1a1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31162024-11-14T04:47:57.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 341f7038-7aa7-4619-9c0a-bf35b31b2ab8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31172024-11-14T04:47:57.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 341f7038-7aa7-4619-9c0a-bf35b31b2ab8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31182024-11-14T04:47:57.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 341f7038-7aa7-4619-9c0a-bf35b31b2ab8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31192024-11-14T04:47:58.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ced915a1-23eb-485e-a526-c230e9eebc68 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31202024-11-14T04:47:58.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ced915a1-23eb-485e-a526-c230e9eebc68 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31212024-11-14T04:47:58.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ced915a1-23eb-485e-a526-c230e9eebc68 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31222024-11-14T04:47:59.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef03689b-a4e2-43f3-894c-30d2bc02af8c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31232024-11-14T04:47:59.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef03689b-a4e2-43f3-894c-30d2bc02af8c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31242024-11-14T04:47:59.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef03689b-a4e2-43f3-894c-30d2bc02af8c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31252024-11-14T04:48:00.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff72e178-35f5-4181-84df-f985a323393c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31262024-11-14T04:48:00.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff72e178-35f5-4181-84df-f985a323393c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31272024-11-14T04:48:00.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff72e178-35f5-4181-84df-f985a323393c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31282024-11-14T04:48:01.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa8d3f16-bfbc-4438-9c8d-7d0c1cee2eb2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31292024-11-14T04:48:01.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa8d3f16-bfbc-4438-9c8d-7d0c1cee2eb2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31302024-11-14T04:48:01.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa8d3f16-bfbc-4438-9c8d-7d0c1cee2eb2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31312024-11-14T04:48:02.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 68640551-b96c-4b8e-b811-8eeb4d4e6c23 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31322024-11-14T04:48:02.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 68640551-b96c-4b8e-b811-8eeb4d4e6c23 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31332024-11-14T04:48:02.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 68640551-b96c-4b8e-b811-8eeb4d4e6c23 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31342024-11-14T04:48:03.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9482d10d-d777-42ef-a75e-d99339782ca6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31352024-11-14T04:48:03.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9482d10d-d777-42ef-a75e-d99339782ca6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31362024-11-14T04:48:03.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9482d10d-d777-42ef-a75e-d99339782ca6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31372024-11-14T04:48:04.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8a69951b-9225-41da-816a-46f25d64506f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31382024-11-14T04:48:04.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8a69951b-9225-41da-816a-46f25d64506f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31392024-11-14T04:48:04.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8a69951b-9225-41da-816a-46f25d64506f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31402024-11-14T04:48:05.261ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = a61ad3b8-5e41-4d48-bb9f-e57cec326402 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
31412024-11-14T04:48:05.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
31422024-11-14T04:48:05.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
31432024-11-14T04:48:05.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31442024-11-14T04:48:05.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31452024-11-14T04:48:05.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31462024-11-14T04:48:05.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31472024-11-14T04:48:05.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31482024-11-14T04:48:05.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31492024-11-14T04:48:05.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31502024-11-14T04:48:05.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31512024-11-14T04:48:05.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31522024-11-14T04:48:05.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31532024-11-14T04:48:05.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31542024-11-14T04:48:05.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31552024-11-14T04:48:05.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31562024-11-14T04:48:05.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
31572024-11-14T04:48:05.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31582024-11-14T04:48:05.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31592024-11-14T04:48:05.341ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.011038ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31602024-11-14T04:48:05.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
31612024-11-14T04:48:05.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 126.212165ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
31622024-11-14T04:48:05.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f4d9010-6776-481f-8133-cfb42a3396c0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31632024-11-14T04:48:05.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f4d9010-6776-481f-8133-cfb42a3396c0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31642024-11-14T04:48:05.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f4d9010-6776-481f-8133-cfb42a3396c0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31652024-11-14T04:48:06.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2839eb97-9cdc-44b0-a28e-c534ff5f03a5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31662024-11-14T04:48:06.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2839eb97-9cdc-44b0-a28e-c534ff5f03a5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31672024-11-14T04:48:06.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2839eb97-9cdc-44b0-a28e-c534ff5f03a5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31682024-11-14T04:48:07.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 82e384f9-1e6b-464c-9a3d-e81ddde7387c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31692024-11-14T04:48:07.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 82e384f9-1e6b-464c-9a3d-e81ddde7387c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31702024-11-14T04:48:07.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 82e384f9-1e6b-464c-9a3d-e81ddde7387c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31712024-11-14T04:48:08.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f98c54a-3cc0-42c5-b809-a8d0664bf45f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31722024-11-14T04:48:08.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f98c54a-3cc0-42c5-b809-a8d0664bf45f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31732024-11-14T04:48:08.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f98c54a-3cc0-42c5-b809-a8d0664bf45f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31742024-11-14T04:48:09.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bcab596a-d306-4a9e-9074-1069dff3f4b5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31752024-11-14T04:48:09.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bcab596a-d306-4a9e-9074-1069dff3f4b5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31762024-11-14T04:48:09.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bcab596a-d306-4a9e-9074-1069dff3f4b5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31772024-11-14T04:48:10.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07e0ddcf-9215-41b6-aa5c-b0a496a78062 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31782024-11-14T04:48:10.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07e0ddcf-9215-41b6-aa5c-b0a496a78062 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31792024-11-14T04:48:10.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07e0ddcf-9215-41b6-aa5c-b0a496a78062 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31802024-11-14T04:48:11.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ced8dbbc-ec09-47f1-b668-06917a525e47 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31812024-11-14T04:48:11.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ced8dbbc-ec09-47f1-b668-06917a525e47 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31822024-11-14T04:48:11.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ced8dbbc-ec09-47f1-b668-06917a525e47 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31832024-11-14T04:48:12.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9f76a18-a717-4cbc-a264-560fd02d97dc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31842024-11-14T04:48:12.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9f76a18-a717-4cbc-a264-560fd02d97dc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31852024-11-14T04:48:12.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9f76a18-a717-4cbc-a264-560fd02d97dc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31862024-11-14T04:48:13.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 12ad91f1-7b72-414e-952a-d119d0d8f9c9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31872024-11-14T04:48:13.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 12ad91f1-7b72-414e-952a-d119d0d8f9c9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31882024-11-14T04:48:13.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 12ad91f1-7b72-414e-952a-d119d0d8f9c9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31892024-11-14T04:48:14.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 179bdcd1-c184-42ce-9650-84a9324747cd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31902024-11-14T04:48:14.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 179bdcd1-c184-42ce-9650-84a9324747cd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31912024-11-14T04:48:14.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 179bdcd1-c184-42ce-9650-84a9324747cd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
31922024-11-14T04:48:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
31932024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31942024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
31952024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31962024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
31972024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
31982024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31992024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
32002024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32012024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
32022024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32032024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
32042024-11-14T04:48:15.310ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32052024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32062024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
32072024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
32082024-11-14T04:48:15.310ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32092024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32102024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
32112024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32122024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
32132024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32142024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32152024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
32162024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32172024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
32182024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32192024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32202024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
32212024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32222024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
32232024-11-14T04:48:15.310ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:38:15.310208433 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32242024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
32252024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32262024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32272024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
32282024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32292024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
32302024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
32312024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32322024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
32332024-11-14T04:48:15.310ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
32342024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
32352024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.44\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
32362024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32372024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
32382024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32392024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
32402024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32412024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
32422024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32432024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
32442024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32452024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
32462024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
32472024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32482024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
32492024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
32502024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32512024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
32522024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32532024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32542024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32552024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32562024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32572024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32582024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32592024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32602024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32612024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32622024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32632024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32642024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32652024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32662024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32672024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32682024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32692024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32702024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32712024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32722024-11-14T04:48:15.310ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 83232108 } })
32732024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32742024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32752024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32762024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32772024-11-14T04:48:15.310ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 83274259 } })
32782024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32792024-11-14T04:48:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32802024-11-14T04:48:15.311ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
32812024-11-14T04:48:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 958.678\u{b5}s iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
32822024-11-14T04:48:15.311ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
32832024-11-14T04:48:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.111332ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
32842024-11-14T04:48:15.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32852024-11-14T04:48:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32862024-11-14T04:48:15.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32872024-11-14T04:48:15.314ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32882024-11-14T04:48:15.314ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.569762ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32892024-11-14T04:48:15.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32902024-11-14T04:48:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32912024-11-14T04:48:15.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32922024-11-14T04:48:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32932024-11-14T04:48:15.315ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 88201142 } })
32942024-11-14T04:48:15.316ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
32952024-11-14T04:48:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32962024-11-14T04:48:15.316ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32972024-11-14T04:48:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32982024-11-14T04:48:15.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32992024-11-14T04:48:15.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33002024-11-14T04:48:15.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33012024-11-14T04:48:15.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33022024-11-14T04:48:15.319ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33032024-11-14T04:48:15.319ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33042024-11-14T04:48:15.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33052024-11-14T04:48:15.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33062024-11-14T04:48:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33072024-11-14T04:48:15.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33082024-11-14T04:48:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33092024-11-14T04:48:15.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33102024-11-14T04:48:15.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33112024-11-14T04:48:15.324ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33122024-11-14T04:48:15.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33132024-11-14T04:48:15.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33142024-11-14T04:48:15.325ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 97576183 } })
33152024-11-14T04:48:15.325ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
33162024-11-14T04:48:15.325ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33172024-11-14T04:48:15.325ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33182024-11-14T04:48:15.325ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.380526ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33192024-11-14T04:48:15.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33202024-11-14T04:48:15.327ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33212024-11-14T04:48:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33222024-11-14T04:48:15.329ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.795383ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33232024-11-14T04:48:15.333ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33242024-11-14T04:48:15.333ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33252024-11-14T04:48:15.333ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33262024-11-14T04:48:15.334ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1074, tv_nsec: 106746139 } })
33272024-11-14T04:48:15.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33282024-11-14T04:48:15.334ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
33292024-11-14T04:48:15.345ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33302024-11-14T04:48:15.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33312024-11-14T04:48:15.365ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33322024-11-14T04:48:15.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33332024-11-14T04:48:15.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33342024-11-14T04:48:15.368ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33352024-11-14T04:48:15.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33362024-11-14T04:48:15.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33372024-11-14T04:48:15.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33382024-11-14T04:48:15.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33392024-11-14T04:48:15.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33402024-11-14T04:48:15.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33412024-11-14T04:48:15.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33422024-11-14T04:48:15.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33432024-11-14T04:48:15.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33442024-11-14T04:48:15.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33452024-11-14T04:48:15.384ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33462024-11-14T04:48:15.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33472024-11-14T04:48:15.386ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33482024-11-14T04:48:15.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33492024-11-14T04:48:15.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33502024-11-14T04:48:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33512024-11-14T04:48:15.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33522024-11-14T04:48:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33532024-11-14T04:48:15.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542024-11-14T04:48:15.397ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33552024-11-14T04:48:15.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33562024-11-14T04:48:15.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33572024-11-14T04:48:15.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33582024-11-14T04:48:15.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33592024-11-14T04:48:15.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33602024-11-14T04:48:15.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33612024-11-14T04:48:15.418ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:38:15.310208433 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
33622024-11-14T04:48:15.419ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 108.78311ms iteration = 3 status = {"expiration":"2024-11-14T04:38:15.310208433Z","pruned":[]}
33632024-11-14T04:48:15.425ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33642024-11-14T04:48:15.425ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33652024-11-14T04:48:15.425ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.027181ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33662024-11-14T04:48:15.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 115.913326ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
33672024-11-14T04:48:15.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 116.072991ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
33682024-11-14T04:48:15.426ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33692024-11-14T04:48:15.426ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.873275ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33702024-11-14T04:48:15.426ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33712024-11-14T04:48:15.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33722024-11-14T04:48:15.427ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33732024-11-14T04:48:15.427ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33742024-11-14T04:48:15.427ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.783651ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33752024-11-14T04:48:15.431ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33762024-11-14T04:48:15.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33772024-11-14T04:48:15.434ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33782024-11-14T04:48:15.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33792024-11-14T04:48:15.436ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 126.411931ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
33802024-11-14T04:48:15.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33812024-11-14T04:48:15.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33822024-11-14T04:48:15.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33832024-11-14T04:48:15.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.470557ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33842024-11-14T04:48:15.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33852024-11-14T04:48:15.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33862024-11-14T04:48:15.452ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33872024-11-14T04:48:15.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33882024-11-14T04:48:15.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33892024-11-14T04:48:15.459ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33902024-11-14T04:48:15.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33912024-11-14T04:48:15.463ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33922024-11-14T04:48:15.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33932024-11-14T04:48:15.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33942024-11-14T04:48:15.464ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33952024-11-14T04:48:15.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33962024-11-14T04:48:15.468ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
33972024-11-14T04:48:15.468ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33982024-11-14T04:48:15.468ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aca817e-ce8b-4383-8cdf-4568839c9355", "content-length": "26", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
33992024-11-14T04:48:15.468ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34002024-11-14T04:48:15.470ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34012024-11-14T04:48:15.477ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34022024-11-14T04:48:15.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34032024-11-14T04:48:15.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34042024-11-14T04:48:15.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 191.180117ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34052024-11-14T04:48:15.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
34062024-11-14T04:48:15.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34072024-11-14T04:48:15.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34082024-11-14T04:48:15.510ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
34092024-11-14T04:48:15.510ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
34102024-11-14T04:48:15.510ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
34112024-11-14T04:48:15.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34122024-11-14T04:48:15.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34132024-11-14T04:48:15.514ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34142024-11-14T04:48:15.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34152024-11-14T04:48:15.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34162024-11-14T04:48:15.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34172024-11-14T04:48:15.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 207.925121ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34182024-11-14T04:48:15.523ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34192024-11-14T04:48:15.531ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
34202024-11-14T04:48:15.531ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 221.394582ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34212024-11-14T04:48:15.547ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
34222024-11-14T04:48:15.547ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34232024-11-14T04:48:15.547ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57f0372f-6fc9-4617-97c2-24d9869cbdae", "content-length": "26", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
34242024-11-14T04:48:15.547ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34252024-11-14T04:48:15.548ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34262024-11-14T04:48:15.555ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34272024-11-14T04:48:15.555ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
34282024-11-14T04:48:15.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34292024-11-14T04:48:15.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34302024-11-14T04:48:15.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34312024-11-14T04:48:15.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34322024-11-14T04:48:15.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34332024-11-14T04:48:15.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34342024-11-14T04:48:15.564ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
34352024-11-14T04:48:15.564ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34362024-11-14T04:48:15.564ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
34372024-11-14T04:48:15.564ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 253.998616ms iteration = 3 status = {"generation":2}
34382024-11-14T04:48:15.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34392024-11-14T04:48:15.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34402024-11-14T04:48:15.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34412024-11-14T04:48:15.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
34422024-11-14T04:48:15.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34432024-11-14T04:48:15.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34442024-11-14T04:48:15.577ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 267.632111ms iteration = 5 status = 0
34452024-11-14T04:48:15.600ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34462024-11-14T04:48:15.601ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cf2c894e-f356-4474-981c-056a2cc51374", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34472024-11-14T04:48:15.601ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34482024-11-14T04:48:15.603ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4448217e-623a-4a12-b8f3-120ec64c5e6d", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34492024-11-14T04:48:15.603ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34502024-11-14T04:48:15.604ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34512024-11-14T04:48:15.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 294.822248ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34522024-11-14T04:48:15.608ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 298.601827ms iteration = 7 status = {"physical_disks_added":0}
34532024-11-14T04:48:15.611ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34542024-11-14T04:48:15.611ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e19921b8-b5dd-4fe8-a61e-4b184eb04507", "content-length": "1", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
34552024-11-14T04:48:15.614ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34562024-11-14T04:48:15.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34572024-11-14T04:48:15.619ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34582024-11-14T04:48:15.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 309.555264ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34592024-11-14T04:48:15.623ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34602024-11-14T04:48:15.623ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34612024-11-14T04:48:15.623ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34622024-11-14T04:48:15.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34632024-11-14T04:48:15.624ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 313.678723ms iteration = 5 status = null
34642024-11-14T04:48:15.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34652024-11-14T04:48:15.626ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
34662024-11-14T04:48:15.626ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34672024-11-14T04:48:15.626ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b03bb3b2-17db-4d91-8793-21ed24fca373", "content-length": "26", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
34682024-11-14T04:48:15.626ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34692024-11-14T04:48:15.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702024-11-14T04:48:15.628ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
34712024-11-14T04:48:15.628ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 318.650557ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
34722024-11-14T04:48:15.629ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
34732024-11-14T04:48:15.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34742024-11-14T04:48:15.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34752024-11-14T04:48:15.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34762024-11-14T04:48:15.660ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 350.459199ms iteration = 5 status = {}
34772024-11-14T04:48:15.661ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34782024-11-14T04:48:15.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34792024-11-14T04:48:15.673ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34802024-11-14T04:48:15.676ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34812024-11-14T04:48:15.676ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34822024-11-14T04:48:15.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34832024-11-14T04:48:15.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34842024-11-14T04:48:15.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34852024-11-14T04:48:15.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34862024-11-14T04:48:15.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34872024-11-14T04:48:15.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34882024-11-14T04:48:15.686ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34892024-11-14T04:48:15.686ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34902024-11-14T04:48:15.686ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
34912024-11-14T04:48:15.686ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 376.002409ms iteration = 3 status = {"generation":1}
34922024-11-14T04:48:15.721ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34932024-11-14T04:48:15.721ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34942024-11-14T04:48:15.721ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb17bd68-4308-4e71-9056-0cabefcc08ba", "content-length": "372", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
34952024-11-14T04:48:15.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34962024-11-14T04:48:15.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34972024-11-14T04:48:15.742ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
34982024-11-14T04:48:15.742ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34992024-11-14T04:48:15.742ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35002024-11-14T04:48:15.742ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "edb2ffc4-b6a2-4331-b717-53c1aabd8af2", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
35012024-11-14T04:48:15.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35022024-11-14T04:48:15.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35032024-11-14T04:48:15.742ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "575db870-afab-42f1-88e4-748635219e2e", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35042024-11-14T04:48:15.742ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35052024-11-14T04:48:15.744ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a0f1140a-a0bb-4251-9973-245337839966", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35062024-11-14T04:48:15.744ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35072024-11-14T04:48:15.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35082024-11-14T04:48:15.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35092024-11-14T04:48:15.746ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "025597b3-5aee-4428-b464-2e1f689b13ea", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35102024-11-14T04:48:15.746ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35112024-11-14T04:48:15.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35122024-11-14T04:48:15.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35132024-11-14T04:48:15.749ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
35142024-11-14T04:48:15.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 439.036734ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35152024-11-14T04:48:15.753ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35162024-11-14T04:48:15.753ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35172024-11-14T04:48:15.753ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "68766018-82e2-4ba4-b728-cbff45d4e225", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
35182024-11-14T04:48:15.755ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 444.972516ms iteration = 5 status = {}
35192024-11-14T04:48:15.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35202024-11-14T04:48:15.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35212024-11-14T04:48:15.807ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
35222024-11-14T04:48:15.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35232024-11-14T04:48:15.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35242024-11-14T04:48:15.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35252024-11-14T04:48:15.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35262024-11-14T04:48:15.817ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35272024-11-14T04:48:15.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35282024-11-14T04:48:15.818ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1d649b3-832b-4c34-9eb8-ebd351de27da", "content-length": "134", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
35292024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35302024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
35312024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35322024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35332024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35342024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35352024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35362024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35372024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35382024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35392024-11-14T04:48:15.818ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
35402024-11-14T04:48:15.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35412024-11-14T04:48:15.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35422024-11-14T04:48:15.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35432024-11-14T04:48:15.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35442024-11-14T04:48:15.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35452024-11-14T04:48:15.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35462024-11-14T04:48:15.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35472024-11-14T04:48:15.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35482024-11-14T04:48:15.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35492024-11-14T04:48:15.828ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35502024-11-14T04:48:15.828ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2917147-7434-4a09-bda2-b1263ab87db3", "content-length": "2", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
35512024-11-14T04:48:15.828ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35522024-11-14T04:48:15.828ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ce38889-05a7-45f6-ab0a-ac61ebb4b804", "content-length": "51", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
35532024-11-14T04:48:15.828ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
35542024-11-14T04:48:15.828ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35552024-11-14T04:48:15.914ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35562024-11-14T04:48:15.931ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f150ea98-9440-4a2c-abad-dc5a3260cba4", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
35572024-11-14T04:48:15.931ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
35582024-11-14T04:48:15.932ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35592024-11-14T04:48:15.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89e0dfc3-1f65-4b26-b060-7f1085e83344 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35602024-11-14T04:48:15.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89e0dfc3-1f65-4b26-b060-7f1085e83344 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35612024-11-14T04:48:15.932ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "11a8ff1d-16e1-4b84-8211-933eaf0010cf", "content-length": "682", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
35622024-11-14T04:48:15.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35632024-11-14T04:48:15.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35642024-11-14T04:48:15.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89e0dfc3-1f65-4b26-b060-7f1085e83344 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35652024-11-14T04:48:15.936ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "282df09c-6d14-4e51-9ab2-5082d8ae4377", "content-length": "691", "date": "Thu, 14 Nov 2024 04:48:15 GMT"} })
35662024-11-14T04:48:15.936ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
35672024-11-14T04:48:15.936ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
35682024-11-14T04:48:15.936ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
35692024-11-14T04:48:15.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35702024-11-14T04:48:15.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35712024-11-14T04:48:15.938ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 628.383936ms iteration = 5 status = {}
35722024-11-14T04:48:15.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35732024-11-14T04:48:15.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35742024-11-14T04:48:15.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35752024-11-14T04:48:15.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35762024-11-14T04:48:15.953ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 642.963898ms iteration = 5 status = {}
35772024-11-14T04:48:16.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 960774ae-91cc-4ddb-8c50-ed9beac9945e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
35782024-11-14T04:48:16.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 960774ae-91cc-4ddb-8c50-ed9beac9945e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
35792024-11-14T04:48:16.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 960774ae-91cc-4ddb-8c50-ed9beac9945e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
35802024-11-14T04:48:16.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7680a3e5-2d1f-449e-910a-4cd0a67e10c4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35812024-11-14T04:48:16.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7680a3e5-2d1f-449e-910a-4cd0a67e10c4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35822024-11-14T04:48:16.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7680a3e5-2d1f-449e-910a-4cd0a67e10c4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35832024-11-14T04:48:17.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d75f4d7-5988-4f63-b7df-7cdad2787ea3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35842024-11-14T04:48:17.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d75f4d7-5988-4f63-b7df-7cdad2787ea3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35852024-11-14T04:48:17.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d75f4d7-5988-4f63-b7df-7cdad2787ea3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35862024-11-14T04:48:19.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 48e11526-14f4-49bf-9a4c-f1e133d2c4c6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35872024-11-14T04:48:19.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 48e11526-14f4-49bf-9a4c-f1e133d2c4c6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35882024-11-14T04:48:19.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 48e11526-14f4-49bf-9a4c-f1e133d2c4c6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35892024-11-14T04:48:20.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 189ada98-6881-46d6-a1b1-debe2b7b421e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35902024-11-14T04:48:20.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 189ada98-6881-46d6-a1b1-debe2b7b421e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35912024-11-14T04:48:20.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 189ada98-6881-46d6-a1b1-debe2b7b421e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35922024-11-14T04:48:20.260ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 568 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 8053ea57-9c07-484c-8070-3836860c3c10 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
35932024-11-14T04:48:21.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8565cf4d-2bc9-4085-8448-b9136906a522 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35942024-11-14T04:48:21.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8565cf4d-2bc9-4085-8448-b9136906a522 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35952024-11-14T04:48:21.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8565cf4d-2bc9-4085-8448-b9136906a522 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35962024-11-14T04:48:22.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1386b650-0b34-46d9-a9da-64f0c9e96d82 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35972024-11-14T04:48:22.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1386b650-0b34-46d9-a9da-64f0c9e96d82 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35982024-11-14T04:48:22.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1386b650-0b34-46d9-a9da-64f0c9e96d82 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
35992024-11-14T04:48:23.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 12e2f481-ec26-423e-a898-0d763ca4dafe roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36002024-11-14T04:48:23.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 12e2f481-ec26-423e-a898-0d763ca4dafe resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36012024-11-14T04:48:23.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 12e2f481-ec26-423e-a898-0d763ca4dafe response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36022024-11-14T04:48:24.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 083079f9-adcb-4369-b522-a261902ef77d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36032024-11-14T04:48:24.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 083079f9-adcb-4369-b522-a261902ef77d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36042024-11-14T04:48:24.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 083079f9-adcb-4369-b522-a261902ef77d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36052024-11-14T04:48:25.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 345d4a1e-85b2-403f-b0d1-0dc16085ff84 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36062024-11-14T04:48:25.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 345d4a1e-85b2-403f-b0d1-0dc16085ff84 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36072024-11-14T04:48:25.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 345d4a1e-85b2-403f-b0d1-0dc16085ff84 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36082024-11-14T04:48:25.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 1bd38cd1-9276-4963-8834-75a51c9b06a2 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
36092024-11-14T04:48:25.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 1bd38cd1-9276-4963-8834-75a51c9b06a2 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
36102024-11-14T04:48:25.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 1bd38cd1-9276-4963-8834-75a51c9b06a2 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
36112024-11-14T04:48:25.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = bfbb7783-a74a-4686-9187-814990a4895c roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
36122024-11-14T04:48:25.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = bfbb7783-a74a-4686-9187-814990a4895c resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
36132024-11-14T04:48:25.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = bfbb7783-a74a-4686-9187-814990a4895c response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
36142024-11-14T04:48:25.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
36152024-11-14T04:48:25.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
36162024-11-14T04:48:25.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36172024-11-14T04:48:25.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36182024-11-14T04:48:25.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36192024-11-14T04:48:25.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36202024-11-14T04:48:25.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36212024-11-14T04:48:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36222024-11-14T04:48:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36232024-11-14T04:48:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36242024-11-14T04:48:25.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36252024-11-14T04:48:25.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36262024-11-14T04:48:25.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36272024-11-14T04:48:25.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
36282024-11-14T04:48:25.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36292024-11-14T04:48:25.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36302024-11-14T04:48:25.346ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36312024-11-14T04:48:25.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36322024-11-14T04:48:25.348ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.813255ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36332024-11-14T04:48:25.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
36342024-11-14T04:48:25.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 125.584097ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
36352024-11-14T04:48:26.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 850ba1aa-33dd-4757-b22f-d2fed6a537da roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36362024-11-14T04:48:26.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 850ba1aa-33dd-4757-b22f-d2fed6a537da resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36372024-11-14T04:48:26.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 850ba1aa-33dd-4757-b22f-d2fed6a537da response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36382024-11-14T04:48:27.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d8f66c4a-a71c-45e6-bff6-4bd4ff80323e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36392024-11-14T04:48:27.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d8f66c4a-a71c-45e6-bff6-4bd4ff80323e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36402024-11-14T04:48:27.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d8f66c4a-a71c-45e6-bff6-4bd4ff80323e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36412024-11-14T04:48:28.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 128966c5-21d3-4d10-ac92-bd2947536276 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36422024-11-14T04:48:28.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 128966c5-21d3-4d10-ac92-bd2947536276 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36432024-11-14T04:48:28.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 128966c5-21d3-4d10-ac92-bd2947536276 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36442024-11-14T04:48:29.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6fe5c06b-f965-4dd0-a08c-0b6eca34dab9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36452024-11-14T04:48:29.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6fe5c06b-f965-4dd0-a08c-0b6eca34dab9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36462024-11-14T04:48:29.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6fe5c06b-f965-4dd0-a08c-0b6eca34dab9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36472024-11-14T04:48:30.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26d0f09d-8bc7-4be8-96e1-a30588c9ae15 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36482024-11-14T04:48:30.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26d0f09d-8bc7-4be8-96e1-a30588c9ae15 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36492024-11-14T04:48:30.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26d0f09d-8bc7-4be8-96e1-a30588c9ae15 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36502024-11-14T04:48:31.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b79ad4de-aaa3-490c-89b9-7e4b385f90d6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36512024-11-14T04:48:31.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b79ad4de-aaa3-490c-89b9-7e4b385f90d6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36522024-11-14T04:48:31.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b79ad4de-aaa3-490c-89b9-7e4b385f90d6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36532024-11-14T04:48:32.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 651e0a5e-d533-4d1d-8de2-dc1491bd2ce1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36542024-11-14T04:48:32.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 651e0a5e-d533-4d1d-8de2-dc1491bd2ce1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36552024-11-14T04:48:32.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 651e0a5e-d533-4d1d-8de2-dc1491bd2ce1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36562024-11-14T04:48:33.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eec5cb13-3090-4ecb-826e-75c15c20fb4e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36572024-11-14T04:48:33.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eec5cb13-3090-4ecb-826e-75c15c20fb4e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36582024-11-14T04:48:33.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eec5cb13-3090-4ecb-826e-75c15c20fb4e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36592024-11-14T04:48:34.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f08d580-8309-47b9-9aa7-767a9cab2046 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36602024-11-14T04:48:34.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f08d580-8309-47b9-9aa7-767a9cab2046 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36612024-11-14T04:48:34.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f08d580-8309-47b9-9aa7-767a9cab2046 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36622024-11-14T04:48:35.261ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 629 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 0d9bf72f-0efe-4145-b854-bc11b9eb30c3 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
36632024-11-14T04:48:35.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
36642024-11-14T04:48:35.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
36652024-11-14T04:48:35.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36662024-11-14T04:48:35.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36672024-11-14T04:48:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36682024-11-14T04:48:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36692024-11-14T04:48:35.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36702024-11-14T04:48:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36712024-11-14T04:48:35.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722024-11-14T04:48:35.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.894563ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36732024-11-14T04:48:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36742024-11-14T04:48:35.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36752024-11-14T04:48:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36762024-11-14T04:48:35.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36772024-11-14T04:48:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36782024-11-14T04:48:35.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36792024-11-14T04:48:35.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
36802024-11-14T04:48:35.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36812024-11-14T04:48:35.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36822024-11-14T04:48:35.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
36832024-11-14T04:48:35.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.946439ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
36842024-11-14T04:48:35.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cf763f37-6335-435a-819b-a350f4bfa622 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36852024-11-14T04:48:35.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cf763f37-6335-435a-819b-a350f4bfa622 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36862024-11-14T04:48:35.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cf763f37-6335-435a-819b-a350f4bfa622 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36872024-11-14T04:48:36.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b072702a-3c2d-434a-b4d1-e482e67d119c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36882024-11-14T04:48:36.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b072702a-3c2d-434a-b4d1-e482e67d119c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36892024-11-14T04:48:36.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b072702a-3c2d-434a-b4d1-e482e67d119c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36902024-11-14T04:48:37.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cb38a37-e9e8-4179-a9e6-57fa708e989a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36912024-11-14T04:48:37.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cb38a37-e9e8-4179-a9e6-57fa708e989a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36922024-11-14T04:48:37.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cb38a37-e9e8-4179-a9e6-57fa708e989a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36932024-11-14T04:48:38.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80aeea46-6d7b-4092-9a4b-0988fed02256 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36942024-11-14T04:48:38.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80aeea46-6d7b-4092-9a4b-0988fed02256 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36952024-11-14T04:48:38.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80aeea46-6d7b-4092-9a4b-0988fed02256 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36962024-11-14T04:48:39.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dbe55cb-dd84-4cd6-8160-f560af2b89f8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36972024-11-14T04:48:39.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dbe55cb-dd84-4cd6-8160-f560af2b89f8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36982024-11-14T04:48:39.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dbe55cb-dd84-4cd6-8160-f560af2b89f8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
36992024-11-14T04:48:40.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1eb797cf-6544-4354-a176-176c948db4f4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37002024-11-14T04:48:40.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1eb797cf-6544-4354-a176-176c948db4f4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37012024-11-14T04:48:40.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1eb797cf-6544-4354-a176-176c948db4f4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37022024-11-14T04:48:41.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a16e0ff8-cde3-4a84-8bc7-6ad246311b1b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37032024-11-14T04:48:41.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a16e0ff8-cde3-4a84-8bc7-6ad246311b1b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37042024-11-14T04:48:41.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a16e0ff8-cde3-4a84-8bc7-6ad246311b1b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37052024-11-14T04:48:42.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c1adf863-0152-4feb-b21f-bb7331fe1069 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37062024-11-14T04:48:42.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c1adf863-0152-4feb-b21f-bb7331fe1069 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37072024-11-14T04:48:42.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c1adf863-0152-4feb-b21f-bb7331fe1069 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37082024-11-14T04:48:43.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 531060b5-4757-4db9-955a-dd25a2432c6a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37092024-11-14T04:48:43.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 531060b5-4757-4db9-955a-dd25a2432c6a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37102024-11-14T04:48:43.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 531060b5-4757-4db9-955a-dd25a2432c6a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37112024-11-14T04:48:44.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0c52dc9c-98bd-41db-a30f-40909b2253a5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37122024-11-14T04:48:44.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0c52dc9c-98bd-41db-a30f-40909b2253a5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37132024-11-14T04:48:44.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0c52dc9c-98bd-41db-a30f-40909b2253a5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
37142024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
37152024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
37162024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37172024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37182024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
37192024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37202024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
37212024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
37222024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
37232024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37242024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37252024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
37262024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
37272024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
37282024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37292024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37302024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37312024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
37322024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
37332024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37342024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37352024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
37362024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37372024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
37382024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37392024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
37402024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
37412024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37422024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37432024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37442024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
37452024-11-14T04:48:45.310ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37462024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37472024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
37482024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37492024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37502024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37512024-11-14T04:48:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37522024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37532024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37542024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37552024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37562024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37572024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37582024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37592024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37602024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37612024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37622024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37632024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37642024-11-14T04:48:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37652024-11-14T04:48:45.313ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37662024-11-14T04:48:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37672024-11-14T04:48:45.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37682024-11-14T04:48:45.314ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37692024-11-14T04:48:45.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37702024-11-14T04:48:45.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.903492ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
37712024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37722024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37732024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37742024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37752024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37762024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37772024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37782024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37792024-11-14T04:48:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37802024-11-14T04:48:45.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.435974ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
37812024-11-14T04:48:45.320ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 92810622 } })
37822024-11-14T04:48:45.320ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
37832024-11-14T04:48:45.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37842024-11-14T04:48:45.321ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 93798461 } })
37852024-11-14T04:48:45.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37862024-11-14T04:48:45.321ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
37872024-11-14T04:48:45.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37882024-11-14T04:48:45.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37892024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37902024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37912024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37922024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37932024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37942024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37952024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37962024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37972024-11-14T04:48:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37982024-11-14T04:48:45.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37992024-11-14T04:48:45.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38002024-11-14T04:48:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38012024-11-14T04:48:45.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38022024-11-14T04:48:45.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38032024-11-14T04:48:45.329ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38042024-11-14T04:48:45.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38052024-11-14T04:48:45.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38062024-11-14T04:48:45.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
38072024-11-14T04:48:45.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38082024-11-14T04:48:45.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38092024-11-14T04:48:45.335ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38102024-11-14T04:48:45.335ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1104, tv_nsec: 108628411 } })
38112024-11-14T04:48:45.336ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
38122024-11-14T04:48:45.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38132024-11-14T04:48:45.338ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38142024-11-14T04:48:45.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38152024-11-14T04:48:45.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38162024-11-14T04:48:45.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38172024-11-14T04:48:45.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38182024-11-14T04:48:45.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38192024-11-14T04:48:45.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38202024-11-14T04:48:45.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38212024-11-14T04:48:45.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.286981ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38222024-11-14T04:48:45.398ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38232024-11-14T04:48:45.398ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38242024-11-14T04:48:45.398ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38252024-11-14T04:48:45.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38262024-11-14T04:48:45.400ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38272024-11-14T04:48:45.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38282024-11-14T04:48:45.401ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38292024-11-14T04:48:45.401ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38302024-11-14T04:48:45.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38312024-11-14T04:48:45.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38322024-11-14T04:48:45.405ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38332024-11-14T04:48:45.405ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.772534ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38342024-11-14T04:48:45.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38352024-11-14T04:48:45.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38362024-11-14T04:48:45.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38372024-11-14T04:48:45.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38382024-11-14T04:48:45.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38392024-11-14T04:48:45.411ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38402024-11-14T04:48:45.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38412024-11-14T04:48:45.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.214309ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38422024-11-14T04:48:45.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
38432024-11-14T04:48:45.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38442024-11-14T04:48:45.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38452024-11-14T04:48:45.417ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.197705ms iteration = 6 status = 0
38462024-11-14T04:48:45.427ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 116.926266ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38472024-11-14T04:48:45.430ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
38482024-11-14T04:48:45.430ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38492024-11-14T04:48:45.430ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a949be05-251a-458c-b31d-457e74dc3595", "content-length": "26", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
38502024-11-14T04:48:45.430ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38512024-11-14T04:48:45.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38522024-11-14T04:48:45.444ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
38532024-11-14T04:48:45.444ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38542024-11-14T04:48:45.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 134.500984ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38552024-11-14T04:48:45.445ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d6e5267-0578-46b5-87b9-a8a4f43a82d0", "content-length": "26", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
38562024-11-14T04:48:45.445ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38572024-11-14T04:48:45.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
38582024-11-14T04:48:45.448ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
38592024-11-14T04:48:45.448ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38602024-11-14T04:48:45.448ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ecb99f-53a1-4d5a-b276-f3209a800ae8", "content-length": "26", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
38612024-11-14T04:48:45.448ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38622024-11-14T04:48:45.450ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38632024-11-14T04:48:45.455ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38642024-11-14T04:48:45.455ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38652024-11-14T04:48:45.455ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.869705ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38662024-11-14T04:48:45.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.789061ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38672024-11-14T04:48:45.458ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
38682024-11-14T04:48:45.458ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 147.871872ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
38692024-11-14T04:48:45.505ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 195.0927ms iteration = 8 status = {"physical_disks_added":0}
38702024-11-14T04:48:45.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38712024-11-14T04:48:45.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38722024-11-14T04:48:45.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38732024-11-14T04:48:45.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38742024-11-14T04:48:45.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752024-11-14T04:48:45.524ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38762024-11-14T04:48:45.525ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38772024-11-14T04:48:45.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38782024-11-14T04:48:45.526ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38792024-11-14T04:48:45.529ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38802024-11-14T04:48:45.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38812024-11-14T04:48:45.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38822024-11-14T04:48:45.537ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38832024-11-14T04:48:45.537ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c822da14-1ce3-44ff-9c87-a9ff71097e25", "content-length": "1", "date": "Thu, 14 Nov 2024 04:48:44 GMT"} })
38842024-11-14T04:48:45.540ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38852024-11-14T04:48:45.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38862024-11-14T04:48:45.542ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 231.851974ms iteration = 6 status = null
38872024-11-14T04:48:45.555ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38882024-11-14T04:48:45.555ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38892024-11-14T04:48:45.556ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "28453080-28c7-400c-bed8-4ade1282c9b4", "content-length": "372", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
38902024-11-14T04:48:45.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38912024-11-14T04:48:45.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38922024-11-14T04:48:45.560ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 249.948188ms iteration = 6 status = {}
38932024-11-14T04:48:45.572ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
38942024-11-14T04:48:45.572ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38952024-11-14T04:48:45.572ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e4c84157-1db3-4023-9bcb-fbe1b2162284", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
38962024-11-14T04:48:45.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38972024-11-14T04:48:45.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38982024-11-14T04:48:45.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c8716564-2532-4ab6-91c9-07bf992ed53a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
38992024-11-14T04:48:45.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c8716564-2532-4ab6-91c9-07bf992ed53a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39002024-11-14T04:48:45.589ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39012024-11-14T04:48:45.589ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "495389c7-73d4-42b1-bf64-ddd86f4ab122", "content-length": "691", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
39022024-11-14T04:48:45.589ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
39032024-11-14T04:48:45.589ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
39042024-11-14T04:48:45.589ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
39052024-11-14T04:48:45.590ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 279.938357ms iteration = 6 status = {}
39062024-11-14T04:48:45.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c8716564-2532-4ab6-91c9-07bf992ed53a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39072024-11-14T04:48:45.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39082024-11-14T04:48:45.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39092024-11-14T04:48:45.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39102024-11-14T04:48:45.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39112024-11-14T04:48:45.598ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39122024-11-14T04:48:45.598ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39132024-11-14T04:48:45.599ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bad45fd3-d0ee-439f-b06c-25d5600aa44a", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
39142024-11-14T04:48:45.600ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.060489ms iteration = 6 status = {}
39152024-11-14T04:48:45.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39162024-11-14T04:48:45.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39172024-11-14T04:48:45.631ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
39182024-11-14T04:48:45.631ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39192024-11-14T04:48:45.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39202024-11-14T04:48:45.637ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39212024-11-14T04:48:45.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7a18dc0-29cd-4686-9132-a73cbcacdfad", "content-length": "134", "date": "Thu, 14 Nov 2024 04:48:44 GMT"} })
39222024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39232024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
39242024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39252024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39262024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39272024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39282024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39292024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39302024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39312024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39322024-11-14T04:48:45.638ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
39332024-11-14T04:48:45.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39342024-11-14T04:48:45.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39352024-11-14T04:48:45.640ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39362024-11-14T04:48:45.640ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9cb62b2-2704-46ee-b201-3dce6491979a", "content-length": "2", "date": "Thu, 14 Nov 2024 04:48:44 GMT"} })
39372024-11-14T04:48:45.640ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39382024-11-14T04:48:45.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf5fc308-ec17-4a2c-9a06-6f0ee44a5c2a", "content-length": "51", "date": "Thu, 14 Nov 2024 04:48:44 GMT"} })
39392024-11-14T04:48:45.641ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
39402024-11-14T04:48:45.641ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39412024-11-14T04:48:45.741ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "84c7d44e-aa0f-43e9-b1f5-16a88bde8f6b", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
39422024-11-14T04:48:45.741ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
39432024-11-14T04:48:45.741ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39442024-11-14T04:48:45.741ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "80930bcd-80b6-4610-8964-e8446631671d", "content-length": "682", "date": "Thu, 14 Nov 2024 04:48:45 GMT"} })
39452024-11-14T04:48:45.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39462024-11-14T04:48:45.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39472024-11-14T04:48:45.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39482024-11-14T04:48:45.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39492024-11-14T04:48:45.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39502024-11-14T04:48:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39512024-11-14T04:48:45.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39522024-11-14T04:48:45.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39532024-11-14T04:48:45.760ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 449.882568ms iteration = 6 status = {}
39542024-11-14T04:48:46.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 9d2e0006-1477-4440-8e2c-b518d9ccbbc6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
39552024-11-14T04:48:46.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 9d2e0006-1477-4440-8e2c-b518d9ccbbc6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
39562024-11-14T04:48:46.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 9d2e0006-1477-4440-8e2c-b518d9ccbbc6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
39572024-11-14T04:48:46.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1d06cb90-5da0-4321-8845-b3ba11fe3d00 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39582024-11-14T04:48:46.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1d06cb90-5da0-4321-8845-b3ba11fe3d00 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39592024-11-14T04:48:46.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1d06cb90-5da0-4321-8845-b3ba11fe3d00 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39602024-11-14T04:48:47.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e79a9270-249e-4f82-a835-b15a0adf11b0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39612024-11-14T04:48:47.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e79a9270-249e-4f82-a835-b15a0adf11b0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39622024-11-14T04:48:47.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e79a9270-249e-4f82-a835-b15a0adf11b0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39632024-11-14T04:48:48.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69e208dd-c117-49f4-bb5e-88331b0a0071 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39642024-11-14T04:48:48.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69e208dd-c117-49f4-bb5e-88331b0a0071 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39652024-11-14T04:48:48.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69e208dd-c117-49f4-bb5e-88331b0a0071 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39662024-11-14T04:48:49.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75b5391a-4dbb-42dd-af06-52e8a142aab1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39672024-11-14T04:48:49.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75b5391a-4dbb-42dd-af06-52e8a142aab1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39682024-11-14T04:48:49.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75b5391a-4dbb-42dd-af06-52e8a142aab1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39692024-11-14T04:48:50.261ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 9b1604d0-7b03-4a5d-ada5-d6f3a21517bb response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
39702024-11-14T04:48:50.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c2406387-72de-4fc5-a755-02b299f8a9be roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39712024-11-14T04:48:50.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c2406387-72de-4fc5-a755-02b299f8a9be resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39722024-11-14T04:48:50.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c2406387-72de-4fc5-a755-02b299f8a9be response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39732024-11-14T04:48:51.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2b01e1a-89a1-4358-9ef2-9875419f100a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39742024-11-14T04:48:51.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2b01e1a-89a1-4358-9ef2-9875419f100a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39752024-11-14T04:48:51.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2b01e1a-89a1-4358-9ef2-9875419f100a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39762024-11-14T04:48:52.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 658b243f-b137-4979-a99c-e3fa45c8eae7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39772024-11-14T04:48:52.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 658b243f-b137-4979-a99c-e3fa45c8eae7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39782024-11-14T04:48:52.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 658b243f-b137-4979-a99c-e3fa45c8eae7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39792024-11-14T04:48:53.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0d0959a-b981-4d0e-ac4d-2c2e19719ee9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39802024-11-14T04:48:53.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0d0959a-b981-4d0e-ac4d-2c2e19719ee9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39812024-11-14T04:48:53.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0d0959a-b981-4d0e-ac4d-2c2e19719ee9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39822024-11-14T04:48:54.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89213e21-54b5-40d5-a591-41c7fa1ba6ea roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39832024-11-14T04:48:54.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89213e21-54b5-40d5-a591-41c7fa1ba6ea resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39842024-11-14T04:48:54.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89213e21-54b5-40d5-a591-41c7fa1ba6ea response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
39852024-11-14T04:48:55.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
39862024-11-14T04:48:55.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
39872024-11-14T04:48:55.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39882024-11-14T04:48:55.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39892024-11-14T04:48:55.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39902024-11-14T04:48:55.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39912024-11-14T04:48:55.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39922024-11-14T04:48:55.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39932024-11-14T04:48:55.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39942024-11-14T04:48:55.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39952024-11-14T04:48:55.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39962024-11-14T04:48:55.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.614034ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39972024-11-14T04:48:55.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39982024-11-14T04:48:55.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39992024-11-14T04:48:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40002024-11-14T04:48:55.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40012024-11-14T04:48:55.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
40022024-11-14T04:48:55.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40032024-11-14T04:48:55.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40042024-11-14T04:48:55.434ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
40052024-11-14T04:48:55.434ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 124.29518ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
40062024-11-14T04:48:55.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58848183-2de1-4161-816a-4ebca5911b6b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40072024-11-14T04:48:55.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58848183-2de1-4161-816a-4ebca5911b6b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40082024-11-14T04:48:55.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58848183-2de1-4161-816a-4ebca5911b6b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40092024-11-14T04:48:56.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5d3dcbfb-c88d-42b8-8ddf-b4fced658eb1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40102024-11-14T04:48:56.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5d3dcbfb-c88d-42b8-8ddf-b4fced658eb1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40112024-11-14T04:48:56.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5d3dcbfb-c88d-42b8-8ddf-b4fced658eb1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40122024-11-14T04:48:57.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4848934d-ec56-49bc-9d99-457150c7aa60 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40132024-11-14T04:48:57.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4848934d-ec56-49bc-9d99-457150c7aa60 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40142024-11-14T04:48:57.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4848934d-ec56-49bc-9d99-457150c7aa60 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40152024-11-14T04:48:58.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83693797-1a8b-494c-bc63-7bcfc245c8be roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40162024-11-14T04:48:58.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83693797-1a8b-494c-bc63-7bcfc245c8be resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40172024-11-14T04:48:58.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83693797-1a8b-494c-bc63-7bcfc245c8be response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40182024-11-14T04:48:59.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 650d95fe-bde3-47f6-a7a6-46253bef3d1b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40192024-11-14T04:48:59.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 650d95fe-bde3-47f6-a7a6-46253bef3d1b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40202024-11-14T04:48:59.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 650d95fe-bde3-47f6-a7a6-46253bef3d1b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40212024-11-14T04:49:00.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b449c3dd-ad17-48f7-82af-d0f2c6fc9671 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40222024-11-14T04:49:00.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b449c3dd-ad17-48f7-82af-d0f2c6fc9671 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40232024-11-14T04:49:00.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b449c3dd-ad17-48f7-82af-d0f2c6fc9671 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40242024-11-14T04:49:01.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ccfbf0fe-6837-4898-9f21-8015e13cf50c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40252024-11-14T04:49:01.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ccfbf0fe-6837-4898-9f21-8015e13cf50c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40262024-11-14T04:49:01.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ccfbf0fe-6837-4898-9f21-8015e13cf50c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40272024-11-14T04:49:02.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ffedf6f6-73d3-4bf8-807a-c9e6683d918d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40282024-11-14T04:49:02.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ffedf6f6-73d3-4bf8-807a-c9e6683d918d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40292024-11-14T04:49:02.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ffedf6f6-73d3-4bf8-807a-c9e6683d918d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40302024-11-14T04:49:03.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c719c9a5-a0b7-4e59-a0bb-9dec234c4c55 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40312024-11-14T04:49:03.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c719c9a5-a0b7-4e59-a0bb-9dec234c4c55 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40322024-11-14T04:49:03.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c719c9a5-a0b7-4e59-a0bb-9dec234c4c55 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40332024-11-14T04:49:05.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afddf239-18a6-4e76-ab3a-09682e2b53a3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40342024-11-14T04:49:05.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afddf239-18a6-4e76-ab3a-09682e2b53a3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40352024-11-14T04:49:05.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afddf239-18a6-4e76-ab3a-09682e2b53a3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40362024-11-14T04:49:05.261ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 596 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 9fc4bba7-cb44-4c0a-bed5-3f73b1c7705e response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
40372024-11-14T04:49:05.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
40382024-11-14T04:49:05.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
40392024-11-14T04:49:05.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40402024-11-14T04:49:05.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40412024-11-14T04:49:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40422024-11-14T04:49:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40432024-11-14T04:49:05.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40442024-11-14T04:49:05.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40452024-11-14T04:49:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40462024-11-14T04:49:05.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.962744ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40472024-11-14T04:49:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40482024-11-14T04:49:05.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40492024-11-14T04:49:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40502024-11-14T04:49:05.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40512024-11-14T04:49:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40522024-11-14T04:49:05.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40532024-11-14T04:49:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
40542024-11-14T04:49:05.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40552024-11-14T04:49:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40562024-11-14T04:49:05.328ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
40572024-11-14T04:49:05.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.824225ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
40582024-11-14T04:49:06.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afbb9073-7fee-4b48-a44e-8fbdf2b65563 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40592024-11-14T04:49:06.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afbb9073-7fee-4b48-a44e-8fbdf2b65563 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40602024-11-14T04:49:06.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afbb9073-7fee-4b48-a44e-8fbdf2b65563 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40612024-11-14T04:49:07.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be19aacc-ad08-4f65-8db9-b227cbc88db3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40622024-11-14T04:49:07.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be19aacc-ad08-4f65-8db9-b227cbc88db3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40632024-11-14T04:49:07.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be19aacc-ad08-4f65-8db9-b227cbc88db3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40642024-11-14T04:49:08.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 24a05171-e1a1-4b76-9e3e-94a404006eb9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40652024-11-14T04:49:08.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 24a05171-e1a1-4b76-9e3e-94a404006eb9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40662024-11-14T04:49:08.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 24a05171-e1a1-4b76-9e3e-94a404006eb9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40672024-11-14T04:49:09.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6652dd3a-c602-4e9c-a973-3d11e78ef277 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40682024-11-14T04:49:09.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6652dd3a-c602-4e9c-a973-3d11e78ef277 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40692024-11-14T04:49:09.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6652dd3a-c602-4e9c-a973-3d11e78ef277 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40702024-11-14T04:49:10.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95370498-c1ee-47b6-9b0c-259e4674d117 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40712024-11-14T04:49:10.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95370498-c1ee-47b6-9b0c-259e4674d117 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40722024-11-14T04:49:10.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95370498-c1ee-47b6-9b0c-259e4674d117 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40732024-11-14T04:49:11.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0ad107a8-63b6-4416-9c3f-05f80a6cd44b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40742024-11-14T04:49:11.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0ad107a8-63b6-4416-9c3f-05f80a6cd44b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40752024-11-14T04:49:11.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0ad107a8-63b6-4416-9c3f-05f80a6cd44b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40762024-11-14T04:49:12.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6e3533bc-a18e-4de3-9cfa-6e021bde2e11 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40772024-11-14T04:49:12.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6e3533bc-a18e-4de3-9cfa-6e021bde2e11 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40782024-11-14T04:49:12.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6e3533bc-a18e-4de3-9cfa-6e021bde2e11 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40792024-11-14T04:49:13.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd26b229-a58d-4297-9757-bccbc0c621c8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40802024-11-14T04:49:13.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd26b229-a58d-4297-9757-bccbc0c621c8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40812024-11-14T04:49:13.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd26b229-a58d-4297-9757-bccbc0c621c8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40822024-11-14T04:49:14.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 61fe849d-41ac-499e-9e46-0091f91da9fc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40832024-11-14T04:49:14.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 61fe849d-41ac-499e-9e46-0091f91da9fc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40842024-11-14T04:49:14.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 61fe849d-41ac-499e-9e46-0091f91da9fc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40852024-11-14T04:49:15.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c5150a01-9c07-427e-946a-1bde012a5796 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40862024-11-14T04:49:15.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c5150a01-9c07-427e-946a-1bde012a5796 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40872024-11-14T04:49:15.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c5150a01-9c07-427e-946a-1bde012a5796 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
40882024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
40892024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
40902024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40912024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
40922024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
40932024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40942024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40952024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
40962024-11-14T04:49:15.309ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40972024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40982024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
40992024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
41002024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41012024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
41022024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
41032024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
41042024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41052024-11-14T04:49:15.310ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
41062024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
41072024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.281\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
41082024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41092024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
41102024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
41112024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41122024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41132024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
41142024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
41152024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41162024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
41172024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41182024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
41192024-11-14T04:49:15.310ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:39:15.310119270 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
41202024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
41212024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
41222024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
41232024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41242024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
41252024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41262024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
41272024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41282024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
41292024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41302024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
41312024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
41322024-11-14T04:49:15.310ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41332024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41342024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41352024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
41362024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41372024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
41382024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41392024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
41402024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41412024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41422024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
41432024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41442024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
41452024-11-14T04:49:15.310ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
41462024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
41472024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41482024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
41492024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41502024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
41512024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41522024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41532024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41542024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41552024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41562024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41572024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41582024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41592024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41602024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41612024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41622024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41632024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41642024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41652024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41662024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41672024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41682024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41692024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41702024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41712024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41722024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41732024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41742024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41752024-11-14T04:49:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41762024-11-14T04:49:15.310ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 83824029 } })
41772024-11-14T04:49:15.310ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 83842870 } })
41782024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41792024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41802024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41812024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41822024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41832024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41842024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
41852024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.286847ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
41862024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
41872024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.137943ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
41882024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41892024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41902024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41912024-11-14T04:49:15.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41922024-11-14T04:49:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41932024-11-14T04:49:15.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41942024-11-14T04:49:15.312ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.875903ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41952024-11-14T04:49:15.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962024-11-14T04:49:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41972024-11-14T04:49:15.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41982024-11-14T04:49:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41992024-11-14T04:49:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42002024-11-14T04:49:15.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42012024-11-14T04:49:15.316ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.640202ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
42022024-11-14T04:49:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42032024-11-14T04:49:15.317ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.660652ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
42042024-11-14T04:49:15.318ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42052024-11-14T04:49:15.319ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 91959295 } })
42062024-11-14T04:49:15.319ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
42072024-11-14T04:49:15.319ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42082024-11-14T04:49:15.319ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42092024-11-14T04:49:15.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42102024-11-14T04:49:15.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42112024-11-14T04:49:15.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
42122024-11-14T04:49:15.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42132024-11-14T04:49:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42142024-11-14T04:49:15.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42152024-11-14T04:49:15.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42162024-11-14T04:49:15.325ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42172024-11-14T04:49:15.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42182024-11-14T04:49:15.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42192024-11-14T04:49:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42202024-11-14T04:49:15.327ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:39:15.310119270 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
42212024-11-14T04:49:15.327ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.476726ms iteration = 4 status = {"expiration":"2024-11-14T04:39:15.310119270Z","pruned":[]}
42222024-11-14T04:49:15.327ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 100755340 } })
42232024-11-14T04:49:15.328ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
42242024-11-14T04:49:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42252024-11-14T04:49:15.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42262024-11-14T04:49:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42272024-11-14T04:49:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42282024-11-14T04:49:15.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42292024-11-14T04:49:15.329ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42302024-11-14T04:49:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42312024-11-14T04:49:15.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42322024-11-14T04:49:15.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42332024-11-14T04:49:15.331ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42342024-11-14T04:49:15.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42352024-11-14T04:49:15.331ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42362024-11-14T04:49:15.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42372024-11-14T04:49:15.332ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42382024-11-14T04:49:15.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42392024-11-14T04:49:15.334ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42402024-11-14T04:49:15.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42412024-11-14T04:49:15.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42422024-11-14T04:49:15.335ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42432024-11-14T04:49:15.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42442024-11-14T04:49:15.335ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42452024-11-14T04:49:15.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42462024-11-14T04:49:15.338ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42472024-11-14T04:49:15.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42482024-11-14T04:49:15.338ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42492024-11-14T04:49:15.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42502024-11-14T04:49:15.340ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42512024-11-14T04:49:15.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42522024-11-14T04:49:15.341ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42532024-11-14T04:49:15.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42542024-11-14T04:49:15.341ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42552024-11-14T04:49:15.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42562024-11-14T04:49:15.343ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42572024-11-14T04:49:15.343ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
42582024-11-14T04:49:15.343ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42592024-11-14T04:49:15.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42602024-11-14T04:49:15.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42612024-11-14T04:49:15.345ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42622024-11-14T04:49:15.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42632024-11-14T04:49:15.345ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1134, tv_nsec: 118866114 } })
42642024-11-14T04:49:15.346ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
42652024-11-14T04:49:15.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42662024-11-14T04:49:15.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42672024-11-14T04:49:15.349ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42682024-11-14T04:49:15.350ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42692024-11-14T04:49:15.350ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42702024-11-14T04:49:15.350ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42712024-11-14T04:49:15.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42722024-11-14T04:49:15.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42732024-11-14T04:49:15.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42742024-11-14T04:49:15.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42752024-11-14T04:49:15.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42762024-11-14T04:49:15.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42772024-11-14T04:49:15.355ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42782024-11-14T04:49:15.355ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42792024-11-14T04:49:15.355ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42802024-11-14T04:49:15.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42812024-11-14T04:49:15.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42822024-11-14T04:49:15.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.236378ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
42832024-11-14T04:49:15.370ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842024-11-14T04:49:15.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42852024-11-14T04:49:15.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42862024-11-14T04:49:15.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42872024-11-14T04:49:15.375ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42882024-11-14T04:49:15.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42892024-11-14T04:49:15.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42902024-11-14T04:49:15.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42912024-11-14T04:49:15.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42922024-11-14T04:49:15.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42932024-11-14T04:49:15.386ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42942024-11-14T04:49:15.386ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42952024-11-14T04:49:15.386ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.423403ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42962024-11-14T04:49:15.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42972024-11-14T04:49:15.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42982024-11-14T04:49:15.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42992024-11-14T04:49:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43002024-11-14T04:49:15.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43012024-11-14T04:49:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43022024-11-14T04:49:15.393ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43032024-11-14T04:49:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43042024-11-14T04:49:15.403ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43052024-11-14T04:49:15.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43062024-11-14T04:49:15.406ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43072024-11-14T04:49:15.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43082024-11-14T04:49:15.433ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43092024-11-14T04:49:15.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43102024-11-14T04:49:15.434ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43112024-11-14T04:49:15.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43122024-11-14T04:49:15.437ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43132024-11-14T04:49:15.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43142024-11-14T04:49:15.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.561154ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43152024-11-14T04:49:15.440ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 130.104158ms iteration = 3 status = {"nsuccess":5}
43162024-11-14T04:49:15.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43172024-11-14T04:49:15.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43182024-11-14T04:49:15.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43192024-11-14T04:49:15.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43202024-11-14T04:49:15.444ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
43212024-11-14T04:49:15.444ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43222024-11-14T04:49:15.444ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 133.906697ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43232024-11-14T04:49:15.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43242024-11-14T04:49:15.445ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43252024-11-14T04:49:15.445ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 135.701339ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43262024-11-14T04:49:15.446ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43272024-11-14T04:49:15.446ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43282024-11-14T04:49:15.446ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.381919ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43292024-11-14T04:49:15.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
43302024-11-14T04:49:15.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43312024-11-14T04:49:15.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43322024-11-14T04:49:15.450ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
43332024-11-14T04:49:15.450ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43342024-11-14T04:49:15.450ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eed57f98-d60d-482d-b5ca-e08598b5d5e5", "content-length": "26", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
43352024-11-14T04:49:15.450ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43362024-11-14T04:49:15.452ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43372024-11-14T04:49:15.454ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43382024-11-14T04:49:15.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43392024-11-14T04:49:15.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.38041ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
43402024-11-14T04:49:15.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43412024-11-14T04:49:15.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43422024-11-14T04:49:15.461ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43432024-11-14T04:49:15.461ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
43442024-11-14T04:49:15.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43452024-11-14T04:49:15.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43462024-11-14T04:49:15.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 175.433181ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43472024-11-14T04:49:15.485ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43482024-11-14T04:49:15.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43492024-11-14T04:49:15.486ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
43502024-11-14T04:49:15.486ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 176.635565ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
43512024-11-14T04:49:15.487ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43522024-11-14T04:49:15.487ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43532024-11-14T04:49:15.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43542024-11-14T04:49:15.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43552024-11-14T04:49:15.492ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
43562024-11-14T04:49:15.492ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 182.002391ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43572024-11-14T04:49:15.501ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43582024-11-14T04:49:15.509ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
43592024-11-14T04:49:15.509ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43602024-11-14T04:49:15.509ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa55d072-4b96-42a0-9a99-f26152d9d408", "content-length": "26", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
43612024-11-14T04:49:15.509ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43622024-11-14T04:49:15.511ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
43632024-11-14T04:49:15.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43642024-11-14T04:49:15.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43652024-11-14T04:49:15.524ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43662024-11-14T04:49:15.533ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43672024-11-14T04:49:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43682024-11-14T04:49:15.540ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43692024-11-14T04:49:15.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43702024-11-14T04:49:15.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
43712024-11-14T04:49:15.541ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43722024-11-14T04:49:15.541ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b442a86-dfe3-4356-9c89-4e786cb144b8", "content-length": "26", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
43732024-11-14T04:49:15.541ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43742024-11-14T04:49:15.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43752024-11-14T04:49:15.616ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43762024-11-14T04:49:15.616ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "34762693-71ac-4743-9727-3b01166223c1", "content-length": "1", "date": "Thu, 14 Nov 2024 04:49:14 GMT"} })
43772024-11-14T04:49:15.618ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43782024-11-14T04:49:15.618ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43792024-11-14T04:49:15.619ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ca01082-d9e5-478d-9600-1043ce3dd814", "content-length": "372", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
43802024-11-14T04:49:15.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43812024-11-14T04:49:15.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43822024-11-14T04:49:15.620ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43832024-11-14T04:49:15.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43842024-11-14T04:49:15.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43852024-11-14T04:49:15.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43862024-11-14T04:49:15.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43872024-11-14T04:49:15.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43882024-11-14T04:49:15.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43892024-11-14T04:49:15.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43902024-11-14T04:49:15.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43912024-11-14T04:49:15.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43922024-11-14T04:49:15.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43932024-11-14T04:49:15.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43942024-11-14T04:49:15.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43952024-11-14T04:49:15.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43962024-11-14T04:49:15.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43972024-11-14T04:49:15.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43982024-11-14T04:49:15.628ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 318.200885ms iteration = 7 status = null
43992024-11-14T04:49:15.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44002024-11-14T04:49:15.630ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
44012024-11-14T04:49:15.630ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
44022024-11-14T04:49:15.630ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
44032024-11-14T04:49:15.630ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 320.882382ms iteration = 4 status = {"generation":2}
44042024-11-14T04:49:15.631ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
44052024-11-14T04:49:15.631ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44062024-11-14T04:49:15.631ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
44072024-11-14T04:49:15.631ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 321.221042ms iteration = 4 status = {"generation":1}
44082024-11-14T04:49:15.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
44092024-11-14T04:49:15.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44102024-11-14T04:49:15.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44112024-11-14T04:49:15.636ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 326.33752ms iteration = 7 status = 0
44122024-11-14T04:49:15.651ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 341.5025ms iteration = 7 status = {}
44132024-11-14T04:49:15.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
44142024-11-14T04:49:15.660ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44152024-11-14T04:49:15.661ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f09531e0-c047-4561-9cb6-05eb143b328e", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44162024-11-14T04:49:15.661ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44172024-11-14T04:49:15.662ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0327d248-7d34-44f4-b374-4d875bd3c28a", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44182024-11-14T04:49:15.662ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44192024-11-14T04:49:15.664ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44202024-11-14T04:49:15.664ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 354.108614ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44212024-11-14T04:49:15.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 355.037921ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44222024-11-14T04:49:15.684ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44232024-11-14T04:49:15.684ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44242024-11-14T04:49:15.685ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "80d6a59b-1230-4f53-b1a6-d5f230075fdb", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
44252024-11-14T04:49:15.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44262024-11-14T04:49:15.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44272024-11-14T04:49:15.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44282024-11-14T04:49:15.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44292024-11-14T04:49:15.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44302024-11-14T04:49:15.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44312024-11-14T04:49:15.693ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
44322024-11-14T04:49:15.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 383.822485ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
44332024-11-14T04:49:15.694ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44342024-11-14T04:49:15.694ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44352024-11-14T04:49:15.694ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6cf89c74-686f-4708-add0-9b98a528be0d", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
44362024-11-14T04:49:15.696ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.798202ms iteration = 7 status = {}
44372024-11-14T04:49:15.711ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44382024-11-14T04:49:15.711ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "2d9a7c65-06f1-46d9-b9fc-ae8f6ab62416", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
44392024-11-14T04:49:15.711ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
44402024-11-14T04:49:15.713ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7b369fdd-c608-4258-9062-f9c43419601f", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
44412024-11-14T04:49:15.713ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
44422024-11-14T04:49:15.715ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fb3675b4-21ad-46d8-ad79-b20236e3d84f", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
44432024-11-14T04:49:15.715ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
44442024-11-14T04:49:15.716ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
44452024-11-14T04:49:15.716ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 406.872303ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44462024-11-14T04:49:15.722ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 412.66777ms iteration = 9 status = {"physical_disks_added":0}
44472024-11-14T04:49:15.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44482024-11-14T04:49:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44492024-11-14T04:49:15.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44502024-11-14T04:49:15.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44512024-11-14T04:49:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44522024-11-14T04:49:15.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44532024-11-14T04:49:15.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44542024-11-14T04:49:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44552024-11-14T04:49:15.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44562024-11-14T04:49:15.731ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
44572024-11-14T04:49:15.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44582024-11-14T04:49:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44592024-11-14T04:49:15.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
44602024-11-14T04:49:15.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44612024-11-14T04:49:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44622024-11-14T04:49:15.765ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44632024-11-14T04:49:15.766ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "05a8c2c2-13f9-4996-9c89-a8e465583161", "content-length": "691", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
44642024-11-14T04:49:15.766ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44652024-11-14T04:49:15.766ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44662024-11-14T04:49:15.766ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44672024-11-14T04:49:15.767ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.021914ms iteration = 7 status = {}
44682024-11-14T04:49:15.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44692024-11-14T04:49:15.955ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "243cd9c2-068b-405e-aac7-f5bb60713f6a", "content-length": "134", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
44702024-11-14T04:49:15.955ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44712024-11-14T04:49:15.955ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
44722024-11-14T04:49:15.955ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44732024-11-14T04:49:15.955ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44742024-11-14T04:49:15.955ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44752024-11-14T04:49:15.955ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44762024-11-14T04:49:15.955ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44772024-11-14T04:49:15.955ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44782024-11-14T04:49:15.956ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44792024-11-14T04:49:15.956ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44802024-11-14T04:49:15.956ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
44812024-11-14T04:49:15.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44822024-11-14T04:49:15.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44832024-11-14T04:49:15.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44842024-11-14T04:49:15.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8f2faee-dbc5-46cc-83bd-c277573bac4c", "content-length": "2", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
44852024-11-14T04:49:15.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44862024-11-14T04:49:15.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cfba5f5-1008-4f59-8125-2c5046cfb993", "content-length": "51", "date": "Thu, 14 Nov 2024 04:49:15 GMT"} })
44872024-11-14T04:49:15.958ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
44882024-11-14T04:49:15.958ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44892024-11-14T04:49:16.105ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "60bcf7b3-ddcf-4c70-9234-a10b77df12ed", "date": "Thu, 14 Nov 2024 04:49:16 GMT"} })
44902024-11-14T04:49:16.106ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
44912024-11-14T04:49:16.106ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44922024-11-14T04:49:16.106ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a052086-0f25-4515-bbf6-02b22dfa4722", "content-length": "682", "date": "Thu, 14 Nov 2024 04:49:16 GMT"} })
44932024-11-14T04:49:16.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44942024-11-14T04:49:16.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44952024-11-14T04:49:16.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44962024-11-14T04:49:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44972024-11-14T04:49:16.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44982024-11-14T04:49:16.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44992024-11-14T04:49:16.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45002024-11-14T04:49:16.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45012024-11-14T04:49:16.122ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 811.850779ms iteration = 7 status = {}
45022024-11-14T04:49:16.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec29b311-a0c5-4e0f-98d4-b7ebeb9cbfc5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45032024-11-14T04:49:16.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec29b311-a0c5-4e0f-98d4-b7ebeb9cbfc5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45042024-11-14T04:49:16.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec29b311-a0c5-4e0f-98d4-b7ebeb9cbfc5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45052024-11-14T04:49:16.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 70cce62e-8323-45c5-ba6b-85791fc5b5be roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
45062024-11-14T04:49:16.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 70cce62e-8323-45c5-ba6b-85791fc5b5be resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
45072024-11-14T04:49:16.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 70cce62e-8323-45c5-ba6b-85791fc5b5be response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
45082024-11-14T04:49:17.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff9eeffb-8fba-4f7b-80ee-f2028018a6bc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45092024-11-14T04:49:17.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff9eeffb-8fba-4f7b-80ee-f2028018a6bc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45102024-11-14T04:49:17.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff9eeffb-8fba-4f7b-80ee-f2028018a6bc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45112024-11-14T04:49:18.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b3929781-21d0-4093-80ed-66e7d1c42d07 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45122024-11-14T04:49:18.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b3929781-21d0-4093-80ed-66e7d1c42d07 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45132024-11-14T04:49:18.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b3929781-21d0-4093-80ed-66e7d1c42d07 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45142024-11-14T04:49:19.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 93c1f3aa-7d2d-4cd5-8802-6aca9f71f69a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45152024-11-14T04:49:19.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 93c1f3aa-7d2d-4cd5-8802-6aca9f71f69a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45162024-11-14T04:49:19.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 93c1f3aa-7d2d-4cd5-8802-6aca9f71f69a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45172024-11-14T04:49:20.261ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 57629c6d-ec7d-4eaa-a65d-63fb28827381 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
45182024-11-14T04:49:20.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5d66a2a-7b35-475b-b9c7-79ab860afc3e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45192024-11-14T04:49:20.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5d66a2a-7b35-475b-b9c7-79ab860afc3e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45202024-11-14T04:49:20.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5d66a2a-7b35-475b-b9c7-79ab860afc3e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45212024-11-14T04:49:21.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9a7024a-047e-43fc-8351-46eb33985252 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45222024-11-14T04:49:21.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9a7024a-047e-43fc-8351-46eb33985252 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45232024-11-14T04:49:21.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9a7024a-047e-43fc-8351-46eb33985252 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45242024-11-14T04:49:22.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f66bb5fb-5860-4386-bee8-6fd76ab409dc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45252024-11-14T04:49:22.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f66bb5fb-5860-4386-bee8-6fd76ab409dc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45262024-11-14T04:49:22.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f66bb5fb-5860-4386-bee8-6fd76ab409dc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45272024-11-14T04:49:23.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7860b4e2-b79b-4f6c-9b9d-ffd4b1a13142 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45282024-11-14T04:49:23.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7860b4e2-b79b-4f6c-9b9d-ffd4b1a13142 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45292024-11-14T04:49:23.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7860b4e2-b79b-4f6c-9b9d-ffd4b1a13142 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45302024-11-14T04:49:24.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33f66cd7-0442-4845-9c87-e1e91ef1d73a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45312024-11-14T04:49:24.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33f66cd7-0442-4845-9c87-e1e91ef1d73a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45322024-11-14T04:49:24.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33f66cd7-0442-4845-9c87-e1e91ef1d73a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45332024-11-14T04:49:25.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
45342024-11-14T04:49:25.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45352024-11-14T04:49:25.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
45362024-11-14T04:49:25.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45372024-11-14T04:49:25.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45382024-11-14T04:49:25.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45392024-11-14T04:49:25.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45402024-11-14T04:49:25.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45412024-11-14T04:49:25.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45422024-11-14T04:49:25.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45432024-11-14T04:49:25.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45442024-11-14T04:49:25.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45452024-11-14T04:49:25.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45462024-11-14T04:49:25.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45472024-11-14T04:49:25.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45482024-11-14T04:49:25.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
45492024-11-14T04:49:25.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45502024-11-14T04:49:25.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45512024-11-14T04:49:25.332ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
45522024-11-14T04:49:25.332ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.403839ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
45532024-11-14T04:49:25.341ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.620076ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45542024-11-14T04:49:25.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 20b5d3e4-3a4e-4f98-b375-e6dbb7d89f92 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45552024-11-14T04:49:25.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 20b5d3e4-3a4e-4f98-b375-e6dbb7d89f92 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45562024-11-14T04:49:25.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 20b5d3e4-3a4e-4f98-b375-e6dbb7d89f92 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45572024-11-14T04:49:26.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2ca9c272-5839-4f5c-a687-019a0410152b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45582024-11-14T04:49:26.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2ca9c272-5839-4f5c-a687-019a0410152b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45592024-11-14T04:49:26.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2ca9c272-5839-4f5c-a687-019a0410152b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45602024-11-14T04:49:27.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 398fd4e6-5948-4d2a-b55a-f7a9cccf4485 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45612024-11-14T04:49:27.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 398fd4e6-5948-4d2a-b55a-f7a9cccf4485 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45622024-11-14T04:49:27.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 398fd4e6-5948-4d2a-b55a-f7a9cccf4485 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45632024-11-14T04:49:28.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 626ad0f9-303d-477e-b47c-3882d1897e5f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45642024-11-14T04:49:28.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 626ad0f9-303d-477e-b47c-3882d1897e5f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45652024-11-14T04:49:28.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 626ad0f9-303d-477e-b47c-3882d1897e5f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45662024-11-14T04:49:29.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 46fe2744-264c-43c3-86d9-1edc8bdde5d0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45672024-11-14T04:49:29.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 46fe2744-264c-43c3-86d9-1edc8bdde5d0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45682024-11-14T04:49:29.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 46fe2744-264c-43c3-86d9-1edc8bdde5d0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45692024-11-14T04:49:30.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 187b393b-da6f-48a1-82aa-69f8bb31347e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45702024-11-14T04:49:30.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 187b393b-da6f-48a1-82aa-69f8bb31347e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45712024-11-14T04:49:30.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 187b393b-da6f-48a1-82aa-69f8bb31347e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45722024-11-14T04:49:31.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f43a52e-a4a8-42e9-afd8-14f10b0b573e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45732024-11-14T04:49:31.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f43a52e-a4a8-42e9-afd8-14f10b0b573e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45742024-11-14T04:49:31.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f43a52e-a4a8-42e9-afd8-14f10b0b573e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45752024-11-14T04:49:32.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc8eddd0-50a9-447a-ba99-e02c35d3ce20 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45762024-11-14T04:49:32.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc8eddd0-50a9-447a-ba99-e02c35d3ce20 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45772024-11-14T04:49:32.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc8eddd0-50a9-447a-ba99-e02c35d3ce20 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45782024-11-14T04:49:33.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32e39e71-f402-459a-b459-1104c6f694e4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45792024-11-14T04:49:33.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32e39e71-f402-459a-b459-1104c6f694e4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45802024-11-14T04:49:33.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32e39e71-f402-459a-b459-1104c6f694e4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45812024-11-14T04:49:34.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8e58873-81fc-446b-936b-2b498f6a0df0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45822024-11-14T04:49:34.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8e58873-81fc-446b-936b-2b498f6a0df0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45832024-11-14T04:49:34.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8e58873-81fc-446b-936b-2b498f6a0df0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
45842024-11-14T04:49:35.261ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = d938f04f-cdb4-4092-92a6-ae08e992bcc9 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
45852024-11-14T04:49:35.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
45862024-11-14T04:49:35.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45872024-11-14T04:49:35.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
45882024-11-14T04:49:35.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45892024-11-14T04:49:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45902024-11-14T04:49:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45912024-11-14T04:49:35.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45922024-11-14T04:49:35.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45932024-11-14T04:49:35.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45942024-11-14T04:49:35.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45952024-11-14T04:49:35.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45962024-11-14T04:49:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45972024-11-14T04:49:35.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45982024-11-14T04:49:35.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
45992024-11-14T04:49:35.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46002024-11-14T04:49:35.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46012024-11-14T04:49:35.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
46022024-11-14T04:49:35.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.313147ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
46032024-11-14T04:49:35.341ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46042024-11-14T04:49:35.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46052024-11-14T04:49:35.374ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.27998ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46062024-11-14T04:49:35.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87b56fd0-88f1-4050-848e-888fd5623736 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46072024-11-14T04:49:35.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87b56fd0-88f1-4050-848e-888fd5623736 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46082024-11-14T04:49:35.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 87b56fd0-88f1-4050-848e-888fd5623736 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46092024-11-14T04:49:36.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d610fa9-769b-4286-a9d2-fd8acebe2bb2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46102024-11-14T04:49:36.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d610fa9-769b-4286-a9d2-fd8acebe2bb2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46112024-11-14T04:49:36.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d610fa9-769b-4286-a9d2-fd8acebe2bb2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46122024-11-14T04:49:37.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 432b62d3-b46f-4aaf-8137-3f789e6f6793 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46132024-11-14T04:49:37.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 432b62d3-b46f-4aaf-8137-3f789e6f6793 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46142024-11-14T04:49:37.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 432b62d3-b46f-4aaf-8137-3f789e6f6793 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46152024-11-14T04:49:38.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 39c7e5a1-ede0-4021-a4dc-ca72e3d1a7ff roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46162024-11-14T04:49:38.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 39c7e5a1-ede0-4021-a4dc-ca72e3d1a7ff resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46172024-11-14T04:49:38.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 39c7e5a1-ede0-4021-a4dc-ca72e3d1a7ff response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46182024-11-14T04:49:39.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d8c6585-7f86-40bf-96e8-e11957034f86 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46192024-11-14T04:49:39.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d8c6585-7f86-40bf-96e8-e11957034f86 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46202024-11-14T04:49:39.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d8c6585-7f86-40bf-96e8-e11957034f86 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46212024-11-14T04:49:40.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 6dcf9fc3-50fd-4d50-805e-f25ac189afa1 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
46222024-11-14T04:49:40.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 6dcf9fc3-50fd-4d50-805e-f25ac189afa1 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
46232024-11-14T04:49:40.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 6dcf9fc3-50fd-4d50-805e-f25ac189afa1 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
46242024-11-14T04:49:40.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 3a64e058-d83f-46ae-96d3-979765d62711 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
46252024-11-14T04:49:40.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 3a64e058-d83f-46ae-96d3-979765d62711 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
46262024-11-14T04:49:40.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 3a64e058-d83f-46ae-96d3-979765d62711 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
46272024-11-14T04:49:40.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7fa08ad7-bb90-4f6a-a939-3c885d88f5c3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46282024-11-14T04:49:40.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7fa08ad7-bb90-4f6a-a939-3c885d88f5c3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46292024-11-14T04:49:40.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7fa08ad7-bb90-4f6a-a939-3c885d88f5c3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46302024-11-14T04:49:41.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df73c45c-b3b6-47a3-b701-f6c6a4f7cda9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46312024-11-14T04:49:41.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df73c45c-b3b6-47a3-b701-f6c6a4f7cda9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46322024-11-14T04:49:41.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df73c45c-b3b6-47a3-b701-f6c6a4f7cda9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46332024-11-14T04:49:42.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dedc5627-be5b-46f4-bbe7-4f4148fada8c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46342024-11-14T04:49:42.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dedc5627-be5b-46f4-bbe7-4f4148fada8c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46352024-11-14T04:49:42.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dedc5627-be5b-46f4-bbe7-4f4148fada8c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46362024-11-14T04:49:43.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a223970-55a6-4086-9de1-db4ccc7dc765 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46372024-11-14T04:49:43.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a223970-55a6-4086-9de1-db4ccc7dc765 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46382024-11-14T04:49:43.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a223970-55a6-4086-9de1-db4ccc7dc765 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46392024-11-14T04:49:44.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1f4f721d-dc08-48ee-9e82-343f421fd7ce roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46402024-11-14T04:49:44.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1f4f721d-dc08-48ee-9e82-343f421fd7ce resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46412024-11-14T04:49:44.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1f4f721d-dc08-48ee-9e82-343f421fd7ce response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
46422024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
46432024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
46442024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46452024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46462024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
46472024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46482024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
46492024-11-14T04:49:45.310ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46502024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
46512024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46522024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46532024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
46542024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
46552024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46562024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46572024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
46582024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
46592024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46602024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
46612024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
46622024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46632024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46642024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
46652024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46662024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46672024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
46682024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46692024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
46702024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46712024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
46722024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46732024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
46742024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46752024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
46762024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46772024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46782024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46792024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46802024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46812024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46822024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46832024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46842024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46852024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46862024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46872024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46882024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46892024-11-14T04:49:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46902024-11-14T04:49:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46912024-11-14T04:49:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46922024-11-14T04:49:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46932024-11-14T04:49:45.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46942024-11-14T04:49:45.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46952024-11-14T04:49:45.314ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 87376548 } })
46962024-11-14T04:49:45.314ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
46972024-11-14T04:49:45.314ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.621964ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46982024-11-14T04:49:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46992024-11-14T04:49:45.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47002024-11-14T04:49:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47012024-11-14T04:49:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47022024-11-14T04:49:45.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47032024-11-14T04:49:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47042024-11-14T04:49:45.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47052024-11-14T04:49:45.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47062024-11-14T04:49:45.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47072024-11-14T04:49:45.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47082024-11-14T04:49:45.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47092024-11-14T04:49:45.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47102024-11-14T04:49:45.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47112024-11-14T04:49:45.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47122024-11-14T04:49:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47132024-11-14T04:49:45.320ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47142024-11-14T04:49:45.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.41093ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
47152024-11-14T04:49:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47162024-11-14T04:49:45.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47172024-11-14T04:49:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47182024-11-14T04:49:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47192024-11-14T04:49:45.322ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47202024-11-14T04:49:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47212024-11-14T04:49:45.323ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.4687ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
47222024-11-14T04:49:45.324ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 97084279 } })
47232024-11-14T04:49:45.324ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
47242024-11-14T04:49:45.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47252024-11-14T04:49:45.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47262024-11-14T04:49:45.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47272024-11-14T04:49:45.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47282024-11-14T04:49:45.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47292024-11-14T04:49:45.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47302024-11-14T04:49:45.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47312024-11-14T04:49:45.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47322024-11-14T04:49:45.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47332024-11-14T04:49:45.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47342024-11-14T04:49:45.332ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1164, tv_nsec: 105067390 } })
47352024-11-14T04:49:45.332ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
47362024-11-14T04:49:45.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47372024-11-14T04:49:45.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47382024-11-14T04:49:45.371ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47392024-11-14T04:49:45.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47402024-11-14T04:49:45.374ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.462107ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47412024-11-14T04:49:45.378ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47422024-11-14T04:49:45.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47432024-11-14T04:49:45.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.564373ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47442024-11-14T04:49:45.387ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
47452024-11-14T04:49:45.387ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47462024-11-14T04:49:45.387ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4b68771-86d4-44d7-933f-f00c9c119a86", "content-length": "26", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
47472024-11-14T04:49:45.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47482024-11-14T04:49:45.389ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47492024-11-14T04:49:45.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47502024-11-14T04:49:45.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47512024-11-14T04:49:45.390ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47522024-11-14T04:49:45.390ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47532024-11-14T04:49:45.390ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47542024-11-14T04:49:45.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47552024-11-14T04:49:45.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47562024-11-14T04:49:45.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47572024-11-14T04:49:45.392ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47582024-11-14T04:49:45.392ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.725237ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47592024-11-14T04:49:45.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47602024-11-14T04:49:45.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47612024-11-14T04:49:45.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47622024-11-14T04:49:45.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47632024-11-14T04:49:45.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47642024-11-14T04:49:45.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
47652024-11-14T04:49:45.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47662024-11-14T04:49:45.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47672024-11-14T04:49:45.401ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.309284ms iteration = 8 status = 0
47682024-11-14T04:49:45.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47692024-11-14T04:49:45.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
47702024-11-14T04:49:45.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47712024-11-14T04:49:45.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47722024-11-14T04:49:45.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732024-11-14T04:49:45.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47742024-11-14T04:49:45.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47752024-11-14T04:49:45.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47762024-11-14T04:49:45.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47772024-11-14T04:49:45.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47782024-11-14T04:49:45.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47792024-11-14T04:49:45.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47802024-11-14T04:49:45.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47812024-11-14T04:49:45.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47822024-11-14T04:49:45.430ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
47832024-11-14T04:49:45.430ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47842024-11-14T04:49:45.431ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c97e994-74e4-47d0-b87c-b59783f8a582", "content-length": "26", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
47852024-11-14T04:49:45.431ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47862024-11-14T04:49:45.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47872024-11-14T04:49:45.441ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
47882024-11-14T04:49:45.441ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.56282ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
47892024-11-14T04:49:45.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.523764ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
47902024-11-14T04:49:45.452ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
47912024-11-14T04:49:45.452ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47922024-11-14T04:49:45.453ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e9ef203-1b5f-45a8-90c1-e986f531c769", "content-length": "26", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
47932024-11-14T04:49:45.453ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47942024-11-14T04:49:45.453ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47952024-11-14T04:49:45.453ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47962024-11-14T04:49:45.454ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47972024-11-14T04:49:45.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47982024-11-14T04:49:45.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
47992024-11-14T04:49:45.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48002024-11-14T04:49:45.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48012024-11-14T04:49:45.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48022024-11-14T04:49:45.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48032024-11-14T04:49:45.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48042024-11-14T04:49:45.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48052024-11-14T04:49:45.494ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.132622ms iteration = 8 status = {}
48062024-11-14T04:49:45.496ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48072024-11-14T04:49:45.496ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48082024-11-14T04:49:45.496ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.807661ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48092024-11-14T04:49:45.582ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48102024-11-14T04:49:45.582ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48112024-11-14T04:49:45.583ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "daaea1ae-321a-4d35-b9e3-24b1247f6393", "content-length": "372", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48122024-11-14T04:49:45.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48132024-11-14T04:49:45.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48142024-11-14T04:49:45.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 275.21044ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48152024-11-14T04:49:45.626ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48162024-11-14T04:49:45.627ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c2b21ef-b3cf-4543-83bb-84cc70ac732c", "content-length": "1", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48172024-11-14T04:49:45.628ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48182024-11-14T04:49:45.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48192024-11-14T04:49:45.632ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48202024-11-14T04:49:45.633ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6822a75d-2fcf-48c5-b4eb-d20a9549b66f", "content-length": "691", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48212024-11-14T04:49:45.633ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48222024-11-14T04:49:45.633ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48232024-11-14T04:49:45.633ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48242024-11-14T04:49:45.634ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 324.348892ms iteration = 8 status = {}
48252024-11-14T04:49:45.635ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 325.451185ms iteration = 8 status = null
48262024-11-14T04:49:45.681ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 370.949932ms iteration = 10 status = {"physical_disks_added":0}
48272024-11-14T04:49:45.681ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48282024-11-14T04:49:45.681ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48292024-11-14T04:49:45.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48302024-11-14T04:49:45.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48312024-11-14T04:49:45.704ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
48322024-11-14T04:49:45.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48332024-11-14T04:49:45.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48342024-11-14T04:49:45.715ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48352024-11-14T04:49:45.715ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb527148-61d6-4a13-a062-02189a8b158c", "content-length": "134", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48362024-11-14T04:49:45.715ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48372024-11-14T04:49:45.715ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
48382024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48392024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48402024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48412024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48422024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48432024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48442024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48452024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48462024-11-14T04:49:45.716ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
48472024-11-14T04:49:45.716ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48482024-11-14T04:49:45.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48492024-11-14T04:49:45.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48502024-11-14T04:49:45.719ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "18182a4a-5a63-4da9-b317-8bd735aaeb68", "content-length": "2", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48512024-11-14T04:49:45.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48522024-11-14T04:49:45.719ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f3931df-d365-4ab7-949a-347bacc47c3e", "content-length": "51", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48532024-11-14T04:49:45.719ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
48542024-11-14T04:49:45.719ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48552024-11-14T04:49:45.783ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "28ad8b16-b2fe-4718-b396-24935ad11eaf", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48562024-11-14T04:49:45.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48572024-11-14T04:49:45.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48582024-11-14T04:49:45.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48592024-11-14T04:49:45.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48602024-11-14T04:49:45.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48612024-11-14T04:49:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48622024-11-14T04:49:45.792ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48632024-11-14T04:49:45.792ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48642024-11-14T04:49:45.793ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e909f68a-b805-409a-9415-954bdf0a91cf", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48652024-11-14T04:49:45.794ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 484.273274ms iteration = 8 status = {}
48662024-11-14T04:49:45.847ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
48672024-11-14T04:49:45.847ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
48682024-11-14T04:49:45.877ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
48692024-11-14T04:49:45.878ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:46711
48702024-11-14T04:49:45.878ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "471b11ac-24ac-4b10-a7ee-3c50d317cd3c", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48712024-11-14T04:49:45.878ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
48722024-11-14T04:49:45.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48732024-11-14T04:49:45.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46711 req_id = c6f41617-de0a-43d9-8079-d398ac4342c6 roles = RoleSet { roles: {} } uri = /metrics/producers
48742024-11-14T04:49:45.878ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "37ab9e7e-b22e-4b2e-a2fd-298b62a26f49", "content-length": "682", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48752024-11-14T04:49:45.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46711 req_id = c6f41617-de0a-43d9-8079-d398ac4342c6 resource = Database result = Ok(()) uri = /metrics/producers
48762024-11-14T04:49:45.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48772024-11-14T04:49:45.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48782024-11-14T04:49:45.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48792024-11-14T04:49:45.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48802024-11-14T04:49:45.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48812024-11-14T04:49:45.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48822024-11-14T04:49:45.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48832024-11-14T04:49:45.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48842024-11-14T04:49:45.896ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 586.422821ms iteration = 8 status = {}
48852024-11-14T04:49:45.917ZINFOnexus: assigned collector to new producer collector_id = 459b411b-9021-43ae-8875-254e55794157 file = nexus/src/app/oximeter.rs:76 producer_id = 79994e02-6747-4071-83af-7872b31640fb
48862024-11-14T04:49:45.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39897 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46711 req_id = c6f41617-de0a-43d9-8079-d398ac4342c6 response_code = 201 uri = /metrics/producers
48872024-11-14T04:49:45.918ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c6f41617-de0a-43d9-8079-d398ac4342c6", "content-length": "41", "date": "Thu, 14 Nov 2024 04:49:45 GMT"} })
48882024-11-14T04:49:45.919ZDEBGnexus (producer-registration-task): registered with nexus successfully
48892024-11-14T04:49:45.919ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
48902024-11-14T04:49:46.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 977a862f-dea7-482c-a792-6d8b4e73fc98 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
48912024-11-14T04:49:46.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 977a862f-dea7-482c-a792-6d8b4e73fc98 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
48922024-11-14T04:49:46.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 977a862f-dea7-482c-a792-6d8b4e73fc98 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
48932024-11-14T04:49:46.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d0fc330c-6269-4c60-a8c1-aa46dee7d5d0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
48942024-11-14T04:49:46.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d0fc330c-6269-4c60-a8c1-aa46dee7d5d0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
48952024-11-14T04:49:46.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d0fc330c-6269-4c60-a8c1-aa46dee7d5d0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
48962024-11-14T04:49:47.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 759360ae-94f5-403a-a6b6-d04c8d1c7092 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
48972024-11-14T04:49:47.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 759360ae-94f5-403a-a6b6-d04c8d1c7092 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
48982024-11-14T04:49:47.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 759360ae-94f5-403a-a6b6-d04c8d1c7092 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
48992024-11-14T04:49:48.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 238de7bb-bfb4-4fcc-ab3b-0725ba82910f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49002024-11-14T04:49:48.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 238de7bb-bfb4-4fcc-ab3b-0725ba82910f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49012024-11-14T04:49:48.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 238de7bb-bfb4-4fcc-ab3b-0725ba82910f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49022024-11-14T04:49:49.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cc5de286-bd13-4296-8e3a-d0d4ef9b6cbd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49032024-11-14T04:49:49.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cc5de286-bd13-4296-8e3a-d0d4ef9b6cbd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49042024-11-14T04:49:49.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cc5de286-bd13-4296-8e3a-d0d4ef9b6cbd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49052024-11-14T04:49:50.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1e946e8-202f-4186-8c44-8e1870e4e93b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49062024-11-14T04:49:50.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1e946e8-202f-4186-8c44-8e1870e4e93b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49072024-11-14T04:49:50.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1e946e8-202f-4186-8c44-8e1870e4e93b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49082024-11-14T04:49:50.262ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 603 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = e0803224-4f99-44e7-8ad7-d0df1a3b3ce4 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
49092024-11-14T04:49:51.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5ac17ee4-8122-4234-8069-780f7c2a5d3e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49102024-11-14T04:49:51.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5ac17ee4-8122-4234-8069-780f7c2a5d3e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49112024-11-14T04:49:51.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5ac17ee4-8122-4234-8069-780f7c2a5d3e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49122024-11-14T04:49:52.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c60f48c8-23bf-46a0-bb57-9faec4510df1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49132024-11-14T04:49:52.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c60f48c8-23bf-46a0-bb57-9faec4510df1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49142024-11-14T04:49:52.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c60f48c8-23bf-46a0-bb57-9faec4510df1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49152024-11-14T04:49:53.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7518fad6-1e3e-4964-bdd1-1c8cfd48107b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49162024-11-14T04:49:53.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7518fad6-1e3e-4964-bdd1-1c8cfd48107b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49172024-11-14T04:49:53.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7518fad6-1e3e-4964-bdd1-1c8cfd48107b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49182024-11-14T04:49:54.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 90b93c1b-c4c7-41cd-81ff-2a3c975ac695 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49192024-11-14T04:49:54.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 90b93c1b-c4c7-41cd-81ff-2a3c975ac695 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49202024-11-14T04:49:54.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 90b93c1b-c4c7-41cd-81ff-2a3c975ac695 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49212024-11-14T04:49:55.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e40f865-3fc8-490c-9d35-704ab89af5e6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49222024-11-14T04:49:55.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e40f865-3fc8-490c-9d35-704ab89af5e6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49232024-11-14T04:49:55.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e40f865-3fc8-490c-9d35-704ab89af5e6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49242024-11-14T04:49:55.310ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
49252024-11-14T04:49:55.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49262024-11-14T04:49:55.310ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
49272024-11-14T04:49:55.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49282024-11-14T04:49:55.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49292024-11-14T04:49:55.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49302024-11-14T04:49:55.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312024-11-14T04:49:55.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49322024-11-14T04:49:55.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49332024-11-14T04:49:55.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49342024-11-14T04:49:55.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49352024-11-14T04:49:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49362024-11-14T04:49:55.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49372024-11-14T04:49:55.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
49382024-11-14T04:49:55.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49392024-11-14T04:49:55.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49402024-11-14T04:49:55.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
49412024-11-14T04:49:55.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.509023ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
49422024-11-14T04:49:55.342ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49432024-11-14T04:49:55.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49442024-11-14T04:49:55.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.096509ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49452024-11-14T04:49:56.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d0aff06-3da8-4716-be0b-00bc5557ed88 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49462024-11-14T04:49:56.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d0aff06-3da8-4716-be0b-00bc5557ed88 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49472024-11-14T04:49:56.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d0aff06-3da8-4716-be0b-00bc5557ed88 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49482024-11-14T04:49:57.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9d34ac9-c2b4-443d-9e4d-648e8316dc32 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49492024-11-14T04:49:57.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9d34ac9-c2b4-443d-9e4d-648e8316dc32 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49502024-11-14T04:49:57.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9d34ac9-c2b4-443d-9e4d-648e8316dc32 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49512024-11-14T04:49:58.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 159eaabb-c55c-4f48-9134-5a05f7c35e2c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49522024-11-14T04:49:58.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 159eaabb-c55c-4f48-9134-5a05f7c35e2c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49532024-11-14T04:49:58.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 159eaabb-c55c-4f48-9134-5a05f7c35e2c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49542024-11-14T04:49:59.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6d9afbc-7d8d-4516-92ac-2bb36d94e22e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49552024-11-14T04:49:59.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6d9afbc-7d8d-4516-92ac-2bb36d94e22e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49562024-11-14T04:49:59.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6d9afbc-7d8d-4516-92ac-2bb36d94e22e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49572024-11-14T04:50:00.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a4ca01d9-d57e-4c36-a979-4b57d2184107 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49582024-11-14T04:50:00.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a4ca01d9-d57e-4c36-a979-4b57d2184107 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49592024-11-14T04:50:00.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a4ca01d9-d57e-4c36-a979-4b57d2184107 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49602024-11-14T04:50:01.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1a696d3b-9f96-43bc-ad73-c3b1a410b5a4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49612024-11-14T04:50:01.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1a696d3b-9f96-43bc-ad73-c3b1a410b5a4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49622024-11-14T04:50:01.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1a696d3b-9f96-43bc-ad73-c3b1a410b5a4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49632024-11-14T04:50:02.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 46d2928d-9343-4c35-95ba-1395d026023c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49642024-11-14T04:50:02.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 46d2928d-9343-4c35-95ba-1395d026023c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49652024-11-14T04:50:02.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 46d2928d-9343-4c35-95ba-1395d026023c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49662024-11-14T04:50:03.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f447998-604a-4feb-ac8d-2e761273fdb1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49672024-11-14T04:50:03.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f447998-604a-4feb-ac8d-2e761273fdb1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49682024-11-14T04:50:03.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f447998-604a-4feb-ac8d-2e761273fdb1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49692024-11-14T04:50:04.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fa58aee7-d6f8-4465-889f-ecc137214b06 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49702024-11-14T04:50:04.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fa58aee7-d6f8-4465-889f-ecc137214b06 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49712024-11-14T04:50:04.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fa58aee7-d6f8-4465-889f-ecc137214b06 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49722024-11-14T04:50:05.261ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 509 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = ddb849c5-f12e-44fd-9b6d-8c4f5da1d202 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
49732024-11-14T04:50:05.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
49742024-11-14T04:50:05.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
49752024-11-14T04:50:05.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49762024-11-14T04:50:05.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49772024-11-14T04:50:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49782024-11-14T04:50:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49792024-11-14T04:50:05.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49802024-11-14T04:50:05.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49812024-11-14T04:50:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49822024-11-14T04:50:05.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.640495ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49832024-11-14T04:50:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49842024-11-14T04:50:05.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49852024-11-14T04:50:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49862024-11-14T04:50:05.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49872024-11-14T04:50:05.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49882024-11-14T04:50:05.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49892024-11-14T04:50:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
49902024-11-14T04:50:05.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49912024-11-14T04:50:05.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49922024-11-14T04:50:05.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
49932024-11-14T04:50:05.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.544732ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
49942024-11-14T04:50:05.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e7b8a3f-3bce-4e2b-8430-9913fd079b3f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49952024-11-14T04:50:05.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e7b8a3f-3bce-4e2b-8430-9913fd079b3f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49962024-11-14T04:50:05.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e7b8a3f-3bce-4e2b-8430-9913fd079b3f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49972024-11-14T04:50:06.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7cf37ae2-23dc-43b6-9fdc-a77a8c721e62 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49982024-11-14T04:50:06.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7cf37ae2-23dc-43b6-9fdc-a77a8c721e62 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
49992024-11-14T04:50:06.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7cf37ae2-23dc-43b6-9fdc-a77a8c721e62 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50002024-11-14T04:50:07.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 945ccad0-621e-4099-92a7-ad6b2f01b005 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50012024-11-14T04:50:07.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 945ccad0-621e-4099-92a7-ad6b2f01b005 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50022024-11-14T04:50:07.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 945ccad0-621e-4099-92a7-ad6b2f01b005 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50032024-11-14T04:50:08.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b53133b5-bade-4711-ada7-355ea934383b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50042024-11-14T04:50:08.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b53133b5-bade-4711-ada7-355ea934383b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50052024-11-14T04:50:08.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b53133b5-bade-4711-ada7-355ea934383b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50062024-11-14T04:50:09.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 36620836-4c54-42c0-8b12-8fa30b43af6d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50072024-11-14T04:50:09.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 36620836-4c54-42c0-8b12-8fa30b43af6d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50082024-11-14T04:50:09.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 36620836-4c54-42c0-8b12-8fa30b43af6d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50092024-11-14T04:50:10.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 427c8132-ba2d-486c-8296-7c910ca01fef roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
50102024-11-14T04:50:10.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 427c8132-ba2d-486c-8296-7c910ca01fef resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
50112024-11-14T04:50:10.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 427c8132-ba2d-486c-8296-7c910ca01fef response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
50122024-11-14T04:50:10.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2629d1ee-65e4-49c5-8ded-92589d044f43 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
50132024-11-14T04:50:10.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2629d1ee-65e4-49c5-8ded-92589d044f43 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
50142024-11-14T04:50:10.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2629d1ee-65e4-49c5-8ded-92589d044f43 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
50152024-11-14T04:50:10.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be540617-b0a0-4fd1-8456-64dd58c539c5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50162024-11-14T04:50:10.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be540617-b0a0-4fd1-8456-64dd58c539c5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50172024-11-14T04:50:10.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be540617-b0a0-4fd1-8456-64dd58c539c5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50182024-11-14T04:50:11.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ae16be48-d0aa-4f9b-830d-4dce2b6056c8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50192024-11-14T04:50:11.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ae16be48-d0aa-4f9b-830d-4dce2b6056c8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50202024-11-14T04:50:11.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ae16be48-d0aa-4f9b-830d-4dce2b6056c8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50212024-11-14T04:50:12.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 79895d1c-4182-4d41-a7ac-a9b9727c913d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50222024-11-14T04:50:12.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 79895d1c-4182-4d41-a7ac-a9b9727c913d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50232024-11-14T04:50:12.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 79895d1c-4182-4d41-a7ac-a9b9727c913d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50242024-11-14T04:50:13.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7095b704-f9d8-4b3a-aafc-0e7e46988094 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50252024-11-14T04:50:13.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7095b704-f9d8-4b3a-aafc-0e7e46988094 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50262024-11-14T04:50:13.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7095b704-f9d8-4b3a-aafc-0e7e46988094 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50272024-11-14T04:50:14.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 19db7cd5-278a-4eab-b2f0-9918e40649b1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50282024-11-14T04:50:14.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 19db7cd5-278a-4eab-b2f0-9918e40649b1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50292024-11-14T04:50:14.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 19db7cd5-278a-4eab-b2f0-9918e40649b1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
50302024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
50312024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
50322024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50332024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50342024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
50352024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
50362024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50372024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
50382024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50392024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50402024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50412024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
50422024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
50432024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50442024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50452024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
50462024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50472024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
50482024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50492024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
50502024-11-14T04:50:15.309ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:40:15.309448583 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50512024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50522024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
50532024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
50542024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50552024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50562024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
50572024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
50582024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50592024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
50602024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50612024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
50622024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50632024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
50642024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
50652024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50662024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50672024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
50682024-11-14T04:50:15.309ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50692024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50702024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
50712024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
50722024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
50732024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50742024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
50752024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50762024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
50772024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50782024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
50792024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
50802024-11-14T04:50:15.309ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50812024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50822024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
50832024-11-14T04:50:15.309ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
50842024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
50852024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50862024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
50872024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50882024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
50892024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50902024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
50912024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50922024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50932024-11-14T04:50:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50942024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50952024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50962024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50972024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50982024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50992024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51002024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51012024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
51022024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51032024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51042024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51052024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51062024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51072024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51082024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51092024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51102024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51112024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51122024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51132024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51142024-11-14T04:50:15.310ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 83517652 } })
51152024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51162024-11-14T04:50:15.310ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 83566074 } })
51172024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51182024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
51192024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.204675ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
51202024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
51212024-11-14T04:50:15.310ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.206035ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
51222024-11-14T04:50:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51232024-11-14T04:50:15.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51242024-11-14T04:50:15.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252024-11-14T04:50:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51262024-11-14T04:50:15.312ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51272024-11-14T04:50:15.312ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 86032215 } })
51282024-11-14T04:50:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51292024-11-14T04:50:15.313ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
51302024-11-14T04:50:15.313ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.109569ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51312024-11-14T04:50:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51322024-11-14T04:50:15.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51332024-11-14T04:50:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51342024-11-14T04:50:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51352024-11-14T04:50:15.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51362024-11-14T04:50:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51372024-11-14T04:50:15.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51382024-11-14T04:50:15.317ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:40:15.309448583 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51392024-11-14T04:50:15.317ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.225598ms iteration = 5 status = {"expiration":"2024-11-14T04:40:15.309448583Z","pruned":[]}
51402024-11-14T04:50:15.318ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 91274527 } })
51412024-11-14T04:50:15.318ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
51422024-11-14T04:50:15.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51432024-11-14T04:50:15.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51442024-11-14T04:50:15.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51452024-11-14T04:50:15.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51462024-11-14T04:50:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51472024-11-14T04:50:15.325ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.639933ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
51482024-11-14T04:50:15.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51492024-11-14T04:50:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51502024-11-14T04:50:15.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51512024-11-14T04:50:15.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51522024-11-14T04:50:15.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51532024-11-14T04:50:15.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51542024-11-14T04:50:15.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51552024-11-14T04:50:15.384ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51562024-11-14T04:50:15.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51572024-11-14T04:50:15.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51582024-11-14T04:50:15.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51592024-11-14T04:50:15.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51602024-11-14T04:50:15.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51612024-11-14T04:50:15.387ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51622024-11-14T04:50:15.389ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51632024-11-14T04:50:15.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51642024-11-14T04:50:15.391ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51652024-11-14T04:50:15.391ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51662024-11-14T04:50:15.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51672024-11-14T04:50:15.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51682024-11-14T04:50:15.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51692024-11-14T04:50:15.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51702024-11-14T04:50:15.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51712024-11-14T04:50:15.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51722024-11-14T04:50:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51732024-11-14T04:50:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51742024-11-14T04:50:15.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51752024-11-14T04:50:15.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51762024-11-14T04:50:15.399ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51772024-11-14T04:50:15.399ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51782024-11-14T04:50:15.399ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 89.844302ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51792024-11-14T04:50:15.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 94.388003ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
51802024-11-14T04:50:15.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51812024-11-14T04:50:15.410ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51822024-11-14T04:50:15.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 100.760238ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
51832024-11-14T04:50:15.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51842024-11-14T04:50:15.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51852024-11-14T04:50:15.414ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51862024-11-14T04:50:15.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51872024-11-14T04:50:15.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.894058ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51882024-11-14T04:50:15.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51892024-11-14T04:50:15.414ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51902024-11-14T04:50:15.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
51912024-11-14T04:50:15.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51922024-11-14T04:50:15.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51932024-11-14T04:50:15.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51942024-11-14T04:50:15.415ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51952024-11-14T04:50:15.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51962024-11-14T04:50:15.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51972024-11-14T04:50:15.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51982024-11-14T04:50:15.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51992024-11-14T04:50:15.418ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52002024-11-14T04:50:15.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52012024-11-14T04:50:15.419ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52022024-11-14T04:50:15.419ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 110.596522ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52032024-11-14T04:50:15.421ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.703375ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
52042024-11-14T04:50:15.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52052024-11-14T04:50:15.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52062024-11-14T04:50:15.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52072024-11-14T04:50:15.423ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52082024-11-14T04:50:15.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52092024-11-14T04:50:15.425ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52102024-11-14T04:50:15.429ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1194, tv_nsec: 202339933 } })
52112024-11-14T04:50:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52122024-11-14T04:50:15.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52132024-11-14T04:50:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52142024-11-14T04:50:15.429ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
52152024-11-14T04:50:15.433ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52162024-11-14T04:50:15.433ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52172024-11-14T04:50:15.433ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52182024-11-14T04:50:15.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52192024-11-14T04:50:15.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52202024-11-14T04:50:15.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52212024-11-14T04:50:15.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52222024-11-14T04:50:15.454ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
52232024-11-14T04:50:15.466ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52242024-11-14T04:50:15.466ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52252024-11-14T04:50:15.466ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52262024-11-14T04:50:15.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52272024-11-14T04:50:15.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52282024-11-14T04:50:15.468ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52292024-11-14T04:50:15.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52302024-11-14T04:50:15.474ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
52312024-11-14T04:50:15.474ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 165.555965ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
52322024-11-14T04:50:15.477ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52332024-11-14T04:50:15.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52342024-11-14T04:50:15.482ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 172.775414ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52352024-11-14T04:50:15.493ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52362024-11-14T04:50:15.494ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52372024-11-14T04:50:15.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52382024-11-14T04:50:15.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52392024-11-14T04:50:15.497ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52402024-11-14T04:50:15.497ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
52412024-11-14T04:50:15.497ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 187.750827ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52422024-11-14T04:50:15.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52432024-11-14T04:50:15.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52442024-11-14T04:50:15.646ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52452024-11-14T04:50:15.654ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
52462024-11-14T04:50:15.654ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52472024-11-14T04:50:15.654ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8572dbf0-b025-4337-a6de-c58cfa2975af", "content-length": "26", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
52482024-11-14T04:50:15.654ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52492024-11-14T04:50:15.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
52502024-11-14T04:50:15.657ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
52512024-11-14T04:50:15.657ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52522024-11-14T04:50:15.657ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52532024-11-14T04:50:15.658ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ea82e3e-a6c4-4661-b60e-01ca8149536f", "content-length": "26", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
52542024-11-14T04:50:15.658ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52552024-11-14T04:50:15.658ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "08b689ae-c572-4931-b102-d6e511451c30", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52562024-11-14T04:50:15.658ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52572024-11-14T04:50:15.660ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52582024-11-14T04:50:15.661ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "973fbac2-e898-4944-8060-ee24466f952f", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52592024-11-14T04:50:15.661ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52602024-11-14T04:50:15.663ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
52612024-11-14T04:50:15.663ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 353.637941ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
52622024-11-14T04:50:15.676ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52632024-11-14T04:50:15.676ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52642024-11-14T04:50:15.677ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "97d639fd-1e08-4125-9911-369efe19ef2c", "content-length": "372", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
52652024-11-14T04:50:15.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52662024-11-14T04:50:15.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52672024-11-14T04:50:15.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52682024-11-14T04:50:15.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52692024-11-14T04:50:15.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 055b74e8-cddd-44ec-8af7-e00310a016c7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
52702024-11-14T04:50:15.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 055b74e8-cddd-44ec-8af7-e00310a016c7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
52712024-11-14T04:50:15.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52722024-11-14T04:50:15.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52732024-11-14T04:50:15.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52742024-11-14T04:50:15.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52752024-11-14T04:50:15.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52762024-11-14T04:50:15.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52772024-11-14T04:50:15.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52782024-11-14T04:50:15.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52792024-11-14T04:50:15.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 055b74e8-cddd-44ec-8af7-e00310a016c7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
52802024-11-14T04:50:15.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52812024-11-14T04:50:15.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
52822024-11-14T04:50:15.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52832024-11-14T04:50:15.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52842024-11-14T04:50:15.699ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 389.696045ms iteration = 9 status = 0
52852024-11-14T04:50:15.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
52862024-11-14T04:50:15.707ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52872024-11-14T04:50:15.707ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38272ea8-9bfb-4e1b-a42b-77ca91bc7178", "content-length": "26", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
52882024-11-14T04:50:15.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52892024-11-14T04:50:15.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52902024-11-14T04:50:15.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52912024-11-14T04:50:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52922024-11-14T04:50:15.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52932024-11-14T04:50:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52942024-11-14T04:50:15.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52952024-11-14T04:50:15.732ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 423.297168ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52962024-11-14T04:50:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52972024-11-14T04:50:15.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52982024-11-14T04:50:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52992024-11-14T04:50:15.735ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53002024-11-14T04:50:15.735ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53012024-11-14T04:50:15.735ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 426.10319ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53022024-11-14T04:50:15.736ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
53032024-11-14T04:50:15.737ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
53042024-11-14T04:50:15.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53052024-11-14T04:50:15.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53062024-11-14T04:50:15.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53072024-11-14T04:50:15.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53082024-11-14T04:50:15.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53092024-11-14T04:50:15.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53102024-11-14T04:50:15.752ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
53112024-11-14T04:50:15.752ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53122024-11-14T04:50:15.752ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d02f21a5-3aa8-4b0f-b097-f90b97ad8ec9", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
53132024-11-14T04:50:15.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53142024-11-14T04:50:15.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53152024-11-14T04:50:15.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53162024-11-14T04:50:15.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53172024-11-14T04:50:15.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53182024-11-14T04:50:15.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53192024-11-14T04:50:15.765ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
53202024-11-14T04:50:15.765ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
53212024-11-14T04:50:15.765ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53222024-11-14T04:50:15.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53232024-11-14T04:50:15.767ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53242024-11-14T04:50:15.767ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53252024-11-14T04:50:15.767ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59172e0f-b7ce-47ab-a998-cadbbbb80d12", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
53262024-11-14T04:50:15.770ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 460.496996ms iteration = 9 status = {}
53272024-11-14T04:50:15.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53282024-11-14T04:50:15.780ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53292024-11-14T04:50:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53302024-11-14T04:50:15.782ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53312024-11-14T04:50:15.782ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4878936d-ed20-4a10-a5f7-6bfec6b45a25", "content-length": "1", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
53322024-11-14T04:50:15.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53332024-11-14T04:50:15.782ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53342024-11-14T04:50:15.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53352024-11-14T04:50:15.784ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53362024-11-14T04:50:15.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53372024-11-14T04:50:15.785ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
53382024-11-14T04:50:15.785ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53392024-11-14T04:50:15.785ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
53402024-11-14T04:50:15.785ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 476.100197ms iteration = 5 status = {"generation":2}
53412024-11-14T04:50:15.786ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 477.053435ms iteration = 9 status = null
53422024-11-14T04:50:15.796ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53432024-11-14T04:50:15.796ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 486.431946ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53442024-11-14T04:50:15.801ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53452024-11-14T04:50:15.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53462024-11-14T04:50:15.813ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 504.136619ms iteration = 11 status = {"physical_disks_added":0}
53472024-11-14T04:50:15.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53482024-11-14T04:50:15.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53492024-11-14T04:50:15.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53502024-11-14T04:50:15.816ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
53512024-11-14T04:50:15.816ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
53522024-11-14T04:50:15.816ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
53532024-11-14T04:50:15.816ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 507.592119ms iteration = 5 status = {"generation":1}
53542024-11-14T04:50:15.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53552024-11-14T04:50:15.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53562024-11-14T04:50:15.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53572024-11-14T04:50:15.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53582024-11-14T04:50:15.822ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 513.574011ms iteration = 9 status = {}
53592024-11-14T04:50:15.892ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53602024-11-14T04:50:15.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f0e756df-9c3e-45fc-aba8-b42f364995c2", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
53612024-11-14T04:50:15.893ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
53622024-11-14T04:50:15.894ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d9b0bb60-64ae-4698-9d18-30f1650e857c", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
53632024-11-14T04:50:15.894ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
53642024-11-14T04:50:15.895ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53652024-11-14T04:50:15.895ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8c606ae-73ed-4d2d-b876-cd6ab9f4b6c9", "content-length": "691", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
53662024-11-14T04:50:15.895ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
53672024-11-14T04:50:15.895ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
53682024-11-14T04:50:15.895ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
53692024-11-14T04:50:15.897ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "336ecdd8-5ca8-4b12-bd2f-a479e30821d7", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
53702024-11-14T04:50:15.897ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
53712024-11-14T04:50:15.898ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 588.756799ms iteration = 9 status = {}
53722024-11-14T04:50:15.899ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
53732024-11-14T04:50:15.899ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 589.963644ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53742024-11-14T04:50:15.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53752024-11-14T04:50:15.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53762024-11-14T04:50:15.920ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
53772024-11-14T04:50:15.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53782024-11-14T04:50:15.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53792024-11-14T04:50:15.933ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53802024-11-14T04:50:15.933ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e783e3c7-1029-4bfb-9c15-200885a84e35", "content-length": "134", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
53812024-11-14T04:50:15.933ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53822024-11-14T04:50:15.933ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
53832024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53842024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53852024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53862024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53872024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53882024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53892024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53902024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53912024-11-14T04:50:15.934ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
53922024-11-14T04:50:15.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53932024-11-14T04:50:15.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53942024-11-14T04:50:15.937ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53952024-11-14T04:50:15.937ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "68e1c715-d037-45fc-9202-1daa2195ee98", "content-length": "2", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
53962024-11-14T04:50:15.937ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53972024-11-14T04:50:15.937ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8085fc5-3d19-42d0-b78f-d9c8283d6451", "content-length": "51", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
53982024-11-14T04:50:15.937ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
53992024-11-14T04:50:15.937ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54002024-11-14T04:50:15.945ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
54012024-11-14T04:50:15.945ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 636.393708ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54022024-11-14T04:50:16.070ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "639274f5-3fdf-4a4c-a860-3757feb5b8a2", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
54032024-11-14T04:50:16.070ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
54042024-11-14T04:50:16.070ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54052024-11-14T04:50:16.071ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4b78e60-43f7-4aad-86bb-6379e4fe4450", "content-length": "682", "date": "Thu, 14 Nov 2024 04:50:15 GMT"} })
54062024-11-14T04:50:16.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54072024-11-14T04:50:16.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54082024-11-14T04:50:16.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54092024-11-14T04:50:16.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54102024-11-14T04:50:16.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54112024-11-14T04:50:16.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54122024-11-14T04:50:16.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54132024-11-14T04:50:16.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54142024-11-14T04:50:16.100ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 790.434519ms iteration = 9 status = {}
54152024-11-14T04:50:16.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 6a0c42cc-aebc-4f71-86fe-e2f7ba39e5b9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
54162024-11-14T04:50:16.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 6a0c42cc-aebc-4f71-86fe-e2f7ba39e5b9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
54172024-11-14T04:50:16.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 6a0c42cc-aebc-4f71-86fe-e2f7ba39e5b9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
54182024-11-14T04:50:16.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dfdb4698-d43e-4b72-bf67-46c28bcb2279 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54192024-11-14T04:50:16.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dfdb4698-d43e-4b72-bf67-46c28bcb2279 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54202024-11-14T04:50:16.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dfdb4698-d43e-4b72-bf67-46c28bcb2279 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54212024-11-14T04:50:17.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c53f9522-b6a0-4475-bd64-7a891662b0a5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54222024-11-14T04:50:17.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c53f9522-b6a0-4475-bd64-7a891662b0a5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54232024-11-14T04:50:17.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c53f9522-b6a0-4475-bd64-7a891662b0a5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54242024-11-14T04:50:18.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5755725d-d6bb-493f-9abd-fc9e684fcce1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54252024-11-14T04:50:18.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5755725d-d6bb-493f-9abd-fc9e684fcce1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54262024-11-14T04:50:18.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5755725d-d6bb-493f-9abd-fc9e684fcce1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54272024-11-14T04:50:19.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 262235e7-fc22-4479-bb58-4c8a29142490 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54282024-11-14T04:50:19.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 262235e7-fc22-4479-bb58-4c8a29142490 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54292024-11-14T04:50:19.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 262235e7-fc22-4479-bb58-4c8a29142490 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54302024-11-14T04:50:20.259ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = cd06fd2a-bb1b-4145-9fb8-0641e3069161 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
54312024-11-14T04:50:20.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 31614f93-b802-4893-aa92-edf1cdae15b5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54322024-11-14T04:50:20.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 31614f93-b802-4893-aa92-edf1cdae15b5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54332024-11-14T04:50:20.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 31614f93-b802-4893-aa92-edf1cdae15b5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54342024-11-14T04:50:21.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe3aaccb-c9d8-4143-a596-f1adab16e479 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54352024-11-14T04:50:21.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe3aaccb-c9d8-4143-a596-f1adab16e479 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54362024-11-14T04:50:21.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe3aaccb-c9d8-4143-a596-f1adab16e479 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54372024-11-14T04:50:22.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 546a5f84-c1fc-4788-98b9-5fa3d27334a0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54382024-11-14T04:50:22.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 546a5f84-c1fc-4788-98b9-5fa3d27334a0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54392024-11-14T04:50:22.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 546a5f84-c1fc-4788-98b9-5fa3d27334a0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54402024-11-14T04:50:23.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 340bf123-7802-410a-adc9-d440a9614c5a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54412024-11-14T04:50:23.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 340bf123-7802-410a-adc9-d440a9614c5a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54422024-11-14T04:50:23.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 340bf123-7802-410a-adc9-d440a9614c5a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54432024-11-14T04:50:24.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 27496309-677f-4f5b-892a-f7a358bd982f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54442024-11-14T04:50:24.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 27496309-677f-4f5b-892a-f7a358bd982f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54452024-11-14T04:50:24.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 27496309-677f-4f5b-892a-f7a358bd982f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54462024-11-14T04:50:25.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
54472024-11-14T04:50:25.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
54482024-11-14T04:50:25.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54492024-11-14T04:50:25.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54502024-11-14T04:50:25.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54512024-11-14T04:50:25.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54522024-11-14T04:50:25.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54532024-11-14T04:50:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54542024-11-14T04:50:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54552024-11-14T04:50:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54562024-11-14T04:50:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54572024-11-14T04:50:25.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54582024-11-14T04:50:25.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54592024-11-14T04:50:25.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
54602024-11-14T04:50:25.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54612024-11-14T04:50:25.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54622024-11-14T04:50:25.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
54632024-11-14T04:50:25.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.231933ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
54642024-11-14T04:50:25.338ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54652024-11-14T04:50:25.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54662024-11-14T04:50:25.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.837515ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54672024-11-14T04:50:25.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 74d177cd-422f-48a0-83cd-fb1eaa134f4a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54682024-11-14T04:50:25.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 74d177cd-422f-48a0-83cd-fb1eaa134f4a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54692024-11-14T04:50:25.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 74d177cd-422f-48a0-83cd-fb1eaa134f4a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54702024-11-14T04:50:26.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b5328da8-bf66-4beb-a2f9-89c698f38471 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54712024-11-14T04:50:26.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b5328da8-bf66-4beb-a2f9-89c698f38471 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54722024-11-14T04:50:26.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b5328da8-bf66-4beb-a2f9-89c698f38471 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54732024-11-14T04:50:27.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0a57a43-6087-4850-b976-6f66187501e0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54742024-11-14T04:50:27.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0a57a43-6087-4850-b976-6f66187501e0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54752024-11-14T04:50:27.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f0a57a43-6087-4850-b976-6f66187501e0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54762024-11-14T04:50:28.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c88058fc-691f-4fe1-b299-2ba07fde201c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54772024-11-14T04:50:28.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c88058fc-691f-4fe1-b299-2ba07fde201c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54782024-11-14T04:50:28.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c88058fc-691f-4fe1-b299-2ba07fde201c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54792024-11-14T04:50:30.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f494ebcb-cea6-4a3b-9a26-af05324ae7bc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54802024-11-14T04:50:30.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f494ebcb-cea6-4a3b-9a26-af05324ae7bc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54812024-11-14T04:50:30.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f494ebcb-cea6-4a3b-9a26-af05324ae7bc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54822024-11-14T04:50:31.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce8624d8-fbb1-488c-ab20-5ca0bad243db roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54832024-11-14T04:50:31.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce8624d8-fbb1-488c-ab20-5ca0bad243db resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54842024-11-14T04:50:31.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce8624d8-fbb1-488c-ab20-5ca0bad243db response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54852024-11-14T04:50:32.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1f22bac5-9262-4261-af3f-d631893001b0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54862024-11-14T04:50:32.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1f22bac5-9262-4261-af3f-d631893001b0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54872024-11-14T04:50:32.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1f22bac5-9262-4261-af3f-d631893001b0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54882024-11-14T04:50:33.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b4d7a664-40f4-416d-9dea-e9b7b0799c00 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54892024-11-14T04:50:33.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b4d7a664-40f4-416d-9dea-e9b7b0799c00 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54902024-11-14T04:50:33.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b4d7a664-40f4-416d-9dea-e9b7b0799c00 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54912024-11-14T04:50:34.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2aa8e55f-3ead-45e6-8477-15af92e87d2e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54922024-11-14T04:50:34.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2aa8e55f-3ead-45e6-8477-15af92e87d2e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54932024-11-14T04:50:34.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2aa8e55f-3ead-45e6-8477-15af92e87d2e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54942024-11-14T04:50:35.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d7bc95a-6353-4be7-b65a-2104a2ab0faf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54952024-11-14T04:50:35.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d7bc95a-6353-4be7-b65a-2104a2ab0faf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54962024-11-14T04:50:35.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d7bc95a-6353-4be7-b65a-2104a2ab0faf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
54972024-11-14T04:50:35.260ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 569ed94b-b3fd-40b5-a8c0-eb6eb0f96a6e response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
54982024-11-14T04:50:35.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
54992024-11-14T04:50:35.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55002024-11-14T04:50:35.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
55012024-11-14T04:50:35.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55022024-11-14T04:50:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55032024-11-14T04:50:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55042024-11-14T04:50:35.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55052024-11-14T04:50:35.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55062024-11-14T04:50:35.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55072024-11-14T04:50:35.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55082024-11-14T04:50:35.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55092024-11-14T04:50:35.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55102024-11-14T04:50:35.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55112024-11-14T04:50:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55122024-11-14T04:50:35.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55132024-11-14T04:50:35.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
55142024-11-14T04:50:35.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55152024-11-14T04:50:35.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55162024-11-14T04:50:35.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
55172024-11-14T04:50:35.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.956966ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
55182024-11-14T04:50:35.340ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.316067ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55192024-11-14T04:50:36.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 987c35cc-0f4f-4148-bc11-5aa036776b5a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55202024-11-14T04:50:36.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 987c35cc-0f4f-4148-bc11-5aa036776b5a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55212024-11-14T04:50:36.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 987c35cc-0f4f-4148-bc11-5aa036776b5a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55222024-11-14T04:50:37.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 84a3d451-9ada-4aac-b561-8951613c081c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55232024-11-14T04:50:37.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 84a3d451-9ada-4aac-b561-8951613c081c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55242024-11-14T04:50:37.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 84a3d451-9ada-4aac-b561-8951613c081c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55252024-11-14T04:50:38.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0428ce8-4d3a-4485-9653-b230b6f4c6ed roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55262024-11-14T04:50:38.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0428ce8-4d3a-4485-9653-b230b6f4c6ed resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55272024-11-14T04:50:38.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0428ce8-4d3a-4485-9653-b230b6f4c6ed response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55282024-11-14T04:50:39.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 71678753-7b58-4d59-9b99-ca4844d09d4e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55292024-11-14T04:50:39.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 71678753-7b58-4d59-9b99-ca4844d09d4e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55302024-11-14T04:50:39.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 71678753-7b58-4d59-9b99-ca4844d09d4e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55312024-11-14T04:50:40.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d94a7248-8a77-42c2-af28-ca2e95ad6eda roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55322024-11-14T04:50:40.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d94a7248-8a77-42c2-af28-ca2e95ad6eda resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55332024-11-14T04:50:40.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d94a7248-8a77-42c2-af28-ca2e95ad6eda response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55342024-11-14T04:50:40.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e88416a4-f4ce-4d45-a9a5-8888e7cd4fa5 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
55352024-11-14T04:50:40.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e88416a4-f4ce-4d45-a9a5-8888e7cd4fa5 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
55362024-11-14T04:50:40.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e88416a4-f4ce-4d45-a9a5-8888e7cd4fa5 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
55372024-11-14T04:50:40.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 8dd42144-482c-47a7-baa8-52b4026c0b8b roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
55382024-11-14T04:50:40.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 8dd42144-482c-47a7-baa8-52b4026c0b8b resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
55392024-11-14T04:50:40.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 8dd42144-482c-47a7-baa8-52b4026c0b8b response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
55402024-11-14T04:50:41.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e366e7e-7dc1-4f37-9f94-6166ef112184 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55412024-11-14T04:50:41.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e366e7e-7dc1-4f37-9f94-6166ef112184 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55422024-11-14T04:50:41.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e366e7e-7dc1-4f37-9f94-6166ef112184 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55432024-11-14T04:50:42.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 490c6ca8-310b-408c-b4ca-67568a6aedd5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55442024-11-14T04:50:42.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 490c6ca8-310b-408c-b4ca-67568a6aedd5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55452024-11-14T04:50:42.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 490c6ca8-310b-408c-b4ca-67568a6aedd5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55462024-11-14T04:50:43.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 30d409a8-9cc4-40ad-85df-eb8382582564 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55472024-11-14T04:50:43.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 30d409a8-9cc4-40ad-85df-eb8382582564 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55482024-11-14T04:50:43.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 30d409a8-9cc4-40ad-85df-eb8382582564 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55492024-11-14T04:50:44.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9b3c3842-afb0-40e6-b8fb-b96888987ae8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55502024-11-14T04:50:44.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9b3c3842-afb0-40e6-b8fb-b96888987ae8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55512024-11-14T04:50:44.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9b3c3842-afb0-40e6-b8fb-b96888987ae8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
55522024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
55532024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55542024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
55552024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55562024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
55572024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55582024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
55592024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
55602024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55612024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55622024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
55632024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
55642024-11-14T04:50:45.309ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55652024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55662024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55672024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
55682024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55692024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55702024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
55712024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
55722024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55732024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
55742024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55752024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
55762024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
55772024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55782024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
55792024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55802024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55812024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
55822024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55832024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
55842024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55852024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
55862024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55872024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55882024-11-14T04:50:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55892024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55902024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55912024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55922024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55932024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
55942024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55952024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55962024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55972024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
55982024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55992024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56002024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56012024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56022024-11-14T04:50:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56032024-11-14T04:50:45.313ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.194112ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56042024-11-14T04:50:45.316ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56052024-11-14T04:50:45.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56062024-11-14T04:50:45.318ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 91848421 } })
56072024-11-14T04:50:45.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56082024-11-14T04:50:45.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56092024-11-14T04:50:45.318ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
56102024-11-14T04:50:45.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56112024-11-14T04:50:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56122024-11-14T04:50:45.320ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56132024-11-14T04:50:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56142024-11-14T04:50:45.321ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 94981502 } })
56152024-11-14T04:50:45.321ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
56162024-11-14T04:50:45.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56172024-11-14T04:50:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56182024-11-14T04:50:45.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a16798fb-1152-4cc3-84ed-9a273cfc3c94 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
56192024-11-14T04:50:45.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a16798fb-1152-4cc3-84ed-9a273cfc3c94 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
56202024-11-14T04:50:45.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a16798fb-1152-4cc3-84ed-9a273cfc3c94 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
56212024-11-14T04:50:45.362ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56222024-11-14T04:50:45.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56232024-11-14T04:50:45.364ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56242024-11-14T04:50:45.364ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56252024-11-14T04:50:45.364ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56262024-11-14T04:50:45.364ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56272024-11-14T04:50:45.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56282024-11-14T04:50:45.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56292024-11-14T04:50:45.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.086792ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
56302024-11-14T04:50:45.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56312024-11-14T04:50:45.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56322024-11-14T04:50:45.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56332024-11-14T04:50:45.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.632703ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
56342024-11-14T04:50:45.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56352024-11-14T04:50:45.379ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1224, tv_nsec: 153342822 } })
56362024-11-14T04:50:45.380ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
56372024-11-14T04:50:45.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56382024-11-14T04:50:45.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56392024-11-14T04:50:45.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56402024-11-14T04:50:45.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56412024-11-14T04:50:45.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56422024-11-14T04:50:45.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56432024-11-14T04:50:45.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56442024-11-14T04:50:45.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56452024-11-14T04:50:45.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56462024-11-14T04:50:45.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56472024-11-14T04:50:45.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56482024-11-14T04:50:45.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56492024-11-14T04:50:45.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56502024-11-14T04:50:45.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56512024-11-14T04:50:45.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56522024-11-14T04:50:45.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56532024-11-14T04:50:45.396ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56542024-11-14T04:50:45.396ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.663669ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56552024-11-14T04:50:45.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56562024-11-14T04:50:45.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56572024-11-14T04:50:45.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56582024-11-14T04:50:45.398ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56592024-11-14T04:50:45.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56602024-11-14T04:50:45.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56612024-11-14T04:50:45.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56622024-11-14T04:50:45.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56632024-11-14T04:50:45.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56642024-11-14T04:50:45.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.469787ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56652024-11-14T04:50:45.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56662024-11-14T04:50:45.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56672024-11-14T04:50:45.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56682024-11-14T04:50:45.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56692024-11-14T04:50:45.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56702024-11-14T04:50:45.408ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 99.287265ms iteration = 12 status = {"physical_disks_added":0}
56712024-11-14T04:50:45.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56722024-11-14T04:50:45.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
56732024-11-14T04:50:45.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56742024-11-14T04:50:45.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56752024-11-14T04:50:45.416ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
56762024-11-14T04:50:45.416ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56772024-11-14T04:50:45.417ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dff24ee-6712-4d48-98c0-c4524615486b", "content-length": "26", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
56782024-11-14T04:50:45.417ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56792024-11-14T04:50:45.419ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56802024-11-14T04:50:45.422ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
56812024-11-14T04:50:45.422ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
56822024-11-14T04:50:45.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.424505ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56832024-11-14T04:50:45.423ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a5b263c-aa2b-4b8b-9850-033289579ecd", "content-length": "26", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
56842024-11-14T04:50:45.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
56852024-11-14T04:50:45.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.874528ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56862024-11-14T04:50:45.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
56872024-11-14T04:50:45.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56882024-11-14T04:50:45.431ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56892024-11-14T04:50:45.431ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56902024-11-14T04:50:45.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56912024-11-14T04:50:45.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56922024-11-14T04:50:45.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56932024-11-14T04:50:45.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56942024-11-14T04:50:45.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56952024-11-14T04:50:45.441ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
56962024-11-14T04:50:45.441ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.697144ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
56972024-11-14T04:50:45.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56982024-11-14T04:50:45.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56992024-11-14T04:50:45.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57002024-11-14T04:50:45.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
57012024-11-14T04:50:45.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57022024-11-14T04:50:45.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57032024-11-14T04:50:45.449ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 140.458057ms iteration = 10 status = 0
57042024-11-14T04:50:45.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57052024-11-14T04:50:45.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57062024-11-14T04:50:45.465ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57072024-11-14T04:50:45.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57082024-11-14T04:50:45.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57092024-11-14T04:50:45.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57102024-11-14T04:50:45.470ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57112024-11-14T04:50:45.472ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57122024-11-14T04:50:45.472ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57132024-11-14T04:50:45.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57142024-11-14T04:50:45.477ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57152024-11-14T04:50:45.477ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57162024-11-14T04:50:45.477ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.889662ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57172024-11-14T04:50:45.482ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
57182024-11-14T04:50:45.482ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57192024-11-14T04:50:45.482ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ef433c8-6f0b-4f71-8b28-b237901ed8eb", "content-length": "26", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57202024-11-14T04:50:45.482ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57212024-11-14T04:50:45.485ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
57222024-11-14T04:50:45.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 183.981287ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
57232024-11-14T04:50:45.502ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57242024-11-14T04:50:45.503ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "17f0064d-a5c8-4975-8911-4079a1af3113", "content-length": "1", "date": "Thu, 14 Nov 2024 04:50:44 GMT"} })
57252024-11-14T04:50:45.504ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57262024-11-14T04:50:45.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57272024-11-14T04:50:45.512ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.945177ms iteration = 10 status = {}
57282024-11-14T04:50:45.539ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57292024-11-14T04:50:45.539ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57302024-11-14T04:50:45.540ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca681ee6-bfc2-4127-b83e-b69700f82119", "content-length": "372", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57312024-11-14T04:50:45.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57322024-11-14T04:50:45.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57332024-11-14T04:50:45.541ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 231.660079ms iteration = 10 status = null
57342024-11-14T04:50:45.583ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57352024-11-14T04:50:45.583ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "47f7999f-60f0-4acb-a7a5-eda75fd51b1a", "content-length": "691", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57362024-11-14T04:50:45.583ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
57372024-11-14T04:50:45.583ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
57382024-11-14T04:50:45.583ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
57392024-11-14T04:50:45.586ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 276.693233ms iteration = 10 status = {}
57402024-11-14T04:50:45.586ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
57412024-11-14T04:50:45.586ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57422024-11-14T04:50:45.587ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ce4ae5e7-83ec-4010-8267-fe5d258c586c", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57432024-11-14T04:50:45.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57442024-11-14T04:50:45.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57452024-11-14T04:50:45.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57462024-11-14T04:50:45.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57472024-11-14T04:50:45.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57482024-11-14T04:50:45.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57492024-11-14T04:50:45.596ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57502024-11-14T04:50:45.596ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57512024-11-14T04:50:45.596ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "def933ec-985d-4c37-96d2-4d46d56766ac", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57522024-11-14T04:50:45.598ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.457623ms iteration = 10 status = {}
57532024-11-14T04:50:45.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57542024-11-14T04:50:45.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57552024-11-14T04:50:45.620ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
57562024-11-14T04:50:45.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57572024-11-14T04:50:45.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57582024-11-14T04:50:45.629ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57592024-11-14T04:50:45.629ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea2895a7-8580-4caa-b51c-2d08026d439a", "content-length": "134", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57602024-11-14T04:50:45.629ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57612024-11-14T04:50:45.629ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
57622024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57632024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57642024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57652024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57662024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57672024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57682024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57692024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57702024-11-14T04:50:45.630ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
57712024-11-14T04:50:45.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57722024-11-14T04:50:45.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57732024-11-14T04:50:45.632ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57742024-11-14T04:50:45.632ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d510e02-f546-4a60-8983-708c00cfc206", "content-length": "2", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57752024-11-14T04:50:45.632ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57762024-11-14T04:50:45.632ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea60189c-f5d0-4b98-8a9a-0fed41b53643", "content-length": "51", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57772024-11-14T04:50:45.632ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
57782024-11-14T04:50:45.632ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57792024-11-14T04:50:45.738ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c58d03d9-348c-44e9-95bd-9aa8b628a456", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57802024-11-14T04:50:45.738ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
57812024-11-14T04:50:45.739ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
57822024-11-14T04:50:45.739ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e27a1da-07e3-405c-a927-a8408143d8bd", "content-length": "682", "date": "Thu, 14 Nov 2024 04:50:45 GMT"} })
57832024-11-14T04:50:45.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57842024-11-14T04:50:45.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57852024-11-14T04:50:45.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57862024-11-14T04:50:45.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57872024-11-14T04:50:45.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57882024-11-14T04:50:45.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57892024-11-14T04:50:45.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57902024-11-14T04:50:45.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57912024-11-14T04:50:45.756ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 446.899102ms iteration = 10 status = {}
57922024-11-14T04:50:46.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 347a4ca1-e044-49ff-a5f5-41a110896bd9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
57932024-11-14T04:50:46.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 347a4ca1-e044-49ff-a5f5-41a110896bd9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
57942024-11-14T04:50:46.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 347a4ca1-e044-49ff-a5f5-41a110896bd9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
57952024-11-14T04:50:46.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 0a9b542d-7259-4c2b-8e18-57934f5d6137 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
57962024-11-14T04:50:46.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 0a9b542d-7259-4c2b-8e18-57934f5d6137 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
57972024-11-14T04:50:46.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 0a9b542d-7259-4c2b-8e18-57934f5d6137 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
57982024-11-14T04:50:47.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07dd7739-660b-4554-a748-38d2fce4d79c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
57992024-11-14T04:50:47.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07dd7739-660b-4554-a748-38d2fce4d79c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58002024-11-14T04:50:47.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07dd7739-660b-4554-a748-38d2fce4d79c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58012024-11-14T04:50:48.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d3f8d10-a5c4-4b76-a92c-e0ba7944f299 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58022024-11-14T04:50:48.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d3f8d10-a5c4-4b76-a92c-e0ba7944f299 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58032024-11-14T04:50:48.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d3f8d10-a5c4-4b76-a92c-e0ba7944f299 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58042024-11-14T04:50:49.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2c00a1d-0181-4d9c-a474-f1577b6b4ca6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58052024-11-14T04:50:49.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2c00a1d-0181-4d9c-a474-f1577b6b4ca6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58062024-11-14T04:50:49.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2c00a1d-0181-4d9c-a474-f1577b6b4ca6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58072024-11-14T04:50:50.260ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 680 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 4bceab3b-25c5-4fe6-acb8-7eb41722dcce response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
58082024-11-14T04:50:50.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa71cd92-cdf2-404c-a07a-c15330a88384 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58092024-11-14T04:50:50.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa71cd92-cdf2-404c-a07a-c15330a88384 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58102024-11-14T04:50:50.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa71cd92-cdf2-404c-a07a-c15330a88384 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58112024-11-14T04:50:51.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5973fd65-e2dc-414f-a262-295af9d78979 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58122024-11-14T04:50:51.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5973fd65-e2dc-414f-a262-295af9d78979 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58132024-11-14T04:50:51.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5973fd65-e2dc-414f-a262-295af9d78979 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58142024-11-14T04:50:52.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a520638b-3fe8-4961-8fa7-4d4c8018cea3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58152024-11-14T04:50:52.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a520638b-3fe8-4961-8fa7-4d4c8018cea3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58162024-11-14T04:50:52.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a520638b-3fe8-4961-8fa7-4d4c8018cea3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58172024-11-14T04:50:53.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 095ff5b9-8899-4e4a-a28f-690fb5a6aeb3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58182024-11-14T04:50:53.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 095ff5b9-8899-4e4a-a28f-690fb5a6aeb3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58192024-11-14T04:50:53.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 095ff5b9-8899-4e4a-a28f-690fb5a6aeb3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58202024-11-14T04:50:54.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cb587dce-e5cf-4486-b46b-69163ad67fcf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58212024-11-14T04:50:54.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cb587dce-e5cf-4486-b46b-69163ad67fcf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58222024-11-14T04:50:54.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cb587dce-e5cf-4486-b46b-69163ad67fcf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58232024-11-14T04:50:55.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
58242024-11-14T04:50:55.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58252024-11-14T04:50:55.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
58262024-11-14T04:50:55.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58272024-11-14T04:50:55.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58282024-11-14T04:50:55.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58292024-11-14T04:50:55.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58302024-11-14T04:50:55.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58312024-11-14T04:50:55.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58322024-11-14T04:50:55.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58332024-11-14T04:50:55.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58342024-11-14T04:50:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58352024-11-14T04:50:55.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58362024-11-14T04:50:55.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
58372024-11-14T04:50:55.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58382024-11-14T04:50:55.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58392024-11-14T04:50:55.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
58402024-11-14T04:50:55.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.780622ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
58412024-11-14T04:50:55.338ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58422024-11-14T04:50:55.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58432024-11-14T04:50:55.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.952788ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58442024-11-14T04:50:55.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 81b80d2c-b546-497f-b3ef-1985fee1c5f9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58452024-11-14T04:50:55.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 81b80d2c-b546-497f-b3ef-1985fee1c5f9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58462024-11-14T04:50:55.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 81b80d2c-b546-497f-b3ef-1985fee1c5f9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58472024-11-14T04:50:56.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d447bc8-e7f1-48a2-be81-5ed8b1416620 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58482024-11-14T04:50:56.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d447bc8-e7f1-48a2-be81-5ed8b1416620 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58492024-11-14T04:50:56.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d447bc8-e7f1-48a2-be81-5ed8b1416620 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58502024-11-14T04:50:57.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0bb43027-27b3-4b4a-bf38-e998c51f1132 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58512024-11-14T04:50:57.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0bb43027-27b3-4b4a-bf38-e998c51f1132 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58522024-11-14T04:50:57.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0bb43027-27b3-4b4a-bf38-e998c51f1132 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58532024-11-14T04:50:58.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 54f13873-ea6e-48bd-8ee1-114702b2a15e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58542024-11-14T04:50:58.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 54f13873-ea6e-48bd-8ee1-114702b2a15e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58552024-11-14T04:50:58.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 54f13873-ea6e-48bd-8ee1-114702b2a15e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58562024-11-14T04:50:59.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80ec61f0-c6f6-42c4-9a72-e25715efbc42 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58572024-11-14T04:50:59.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80ec61f0-c6f6-42c4-9a72-e25715efbc42 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58582024-11-14T04:50:59.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 80ec61f0-c6f6-42c4-9a72-e25715efbc42 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58592024-11-14T04:51:00.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 55275913-996a-4823-9817-8939e9a6ee1c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58602024-11-14T04:51:00.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 55275913-996a-4823-9817-8939e9a6ee1c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58612024-11-14T04:51:00.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 55275913-996a-4823-9817-8939e9a6ee1c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58622024-11-14T04:51:01.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2702d5ca-646e-4924-b1c3-e0a439737989 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58632024-11-14T04:51:01.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2702d5ca-646e-4924-b1c3-e0a439737989 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58642024-11-14T04:51:01.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2702d5ca-646e-4924-b1c3-e0a439737989 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58652024-11-14T04:51:02.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95f60fa7-2f7a-4860-a326-e762d0555b18 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58662024-11-14T04:51:02.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95f60fa7-2f7a-4860-a326-e762d0555b18 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58672024-11-14T04:51:02.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95f60fa7-2f7a-4860-a326-e762d0555b18 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58682024-11-14T04:51:03.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4777d8d8-2cc4-45d9-b7bb-f325cb245373 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58692024-11-14T04:51:03.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4777d8d8-2cc4-45d9-b7bb-f325cb245373 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58702024-11-14T04:51:03.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4777d8d8-2cc4-45d9-b7bb-f325cb245373 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58712024-11-14T04:51:04.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7872206d-f011-4289-a324-32a30ed685e5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58722024-11-14T04:51:04.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7872206d-f011-4289-a324-32a30ed685e5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58732024-11-14T04:51:04.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7872206d-f011-4289-a324-32a30ed685e5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58742024-11-14T04:51:05.259ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 602 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 40c7bcc2-ebd1-44f0-be66-5b6cf3ce8f71 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
58752024-11-14T04:51:05.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
58762024-11-14T04:51:05.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58772024-11-14T04:51:05.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
58782024-11-14T04:51:05.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58792024-11-14T04:51:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58802024-11-14T04:51:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58812024-11-14T04:51:05.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58822024-11-14T04:51:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58832024-11-14T04:51:05.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58842024-11-14T04:51:05.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.900193ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58852024-11-14T04:51:05.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58862024-11-14T04:51:05.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58872024-11-14T04:51:05.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58882024-11-14T04:51:05.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58892024-11-14T04:51:05.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58902024-11-14T04:51:05.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58912024-11-14T04:51:05.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
58922024-11-14T04:51:05.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58932024-11-14T04:51:05.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58942024-11-14T04:51:05.332ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
58952024-11-14T04:51:05.332ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.385177ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
58962024-11-14T04:51:05.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 392d39f9-1b54-4893-b79b-322801ada7bb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58972024-11-14T04:51:05.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 392d39f9-1b54-4893-b79b-322801ada7bb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58982024-11-14T04:51:05.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 392d39f9-1b54-4893-b79b-322801ada7bb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
58992024-11-14T04:51:06.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 604ff323-470c-435d-92a9-c9123e6a95b3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59002024-11-14T04:51:06.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 604ff323-470c-435d-92a9-c9123e6a95b3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59012024-11-14T04:51:06.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 604ff323-470c-435d-92a9-c9123e6a95b3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59022024-11-14T04:51:07.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aca5c105-e0da-4dab-af03-da77bc4dbf0e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59032024-11-14T04:51:07.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aca5c105-e0da-4dab-af03-da77bc4dbf0e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59042024-11-14T04:51:07.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aca5c105-e0da-4dab-af03-da77bc4dbf0e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59052024-11-14T04:51:08.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d0e6795-9da8-49e2-83d1-4faaf44f2c92 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59062024-11-14T04:51:08.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d0e6795-9da8-49e2-83d1-4faaf44f2c92 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59072024-11-14T04:51:08.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d0e6795-9da8-49e2-83d1-4faaf44f2c92 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59082024-11-14T04:51:09.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 997cbcb4-5b3e-485c-87dd-e40dcad721e7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59092024-11-14T04:51:09.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 997cbcb4-5b3e-485c-87dd-e40dcad721e7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59102024-11-14T04:51:09.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 997cbcb4-5b3e-485c-87dd-e40dcad721e7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59112024-11-14T04:51:10.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e06ed559-6180-4a83-a15f-e3090ec73ccb roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
59122024-11-14T04:51:10.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e06ed559-6180-4a83-a15f-e3090ec73ccb resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
59132024-11-14T04:51:10.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e06ed559-6180-4a83-a15f-e3090ec73ccb response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
59142024-11-14T04:51:10.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e40991e5-59a2-4ac6-90c2-4babd68b45ab roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
59152024-11-14T04:51:10.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e40991e5-59a2-4ac6-90c2-4babd68b45ab resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
59162024-11-14T04:51:10.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = e40991e5-59a2-4ac6-90c2-4babd68b45ab response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
59172024-11-14T04:51:10.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f403c3b0-01de-43fa-b63d-097777b89709 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59182024-11-14T04:51:10.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f403c3b0-01de-43fa-b63d-097777b89709 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59192024-11-14T04:51:10.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f403c3b0-01de-43fa-b63d-097777b89709 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59202024-11-14T04:51:11.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e691b721-a580-4aa2-beca-ef80f21c7e3d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59212024-11-14T04:51:11.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e691b721-a580-4aa2-beca-ef80f21c7e3d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59222024-11-14T04:51:11.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e691b721-a580-4aa2-beca-ef80f21c7e3d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59232024-11-14T04:51:12.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f4a1752-bc48-41ca-8187-6de0cdf4a8e5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59242024-11-14T04:51:12.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f4a1752-bc48-41ca-8187-6de0cdf4a8e5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59252024-11-14T04:51:12.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3f4a1752-bc48-41ca-8187-6de0cdf4a8e5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59262024-11-14T04:51:13.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 930f09bb-b1b7-45a1-a28a-40a07eee3413 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59272024-11-14T04:51:13.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 930f09bb-b1b7-45a1-a28a-40a07eee3413 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59282024-11-14T04:51:13.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 930f09bb-b1b7-45a1-a28a-40a07eee3413 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59292024-11-14T04:51:14.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc470b07-7307-4325-a833-e58eb02fa00e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59302024-11-14T04:51:14.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc470b07-7307-4325-a833-e58eb02fa00e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59312024-11-14T04:51:14.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc470b07-7307-4325-a833-e58eb02fa00e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
59322024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
59332024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59342024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
59352024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
59362024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59372024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
59382024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59392024-11-14T04:51:15.309ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:41:15.309179854 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59402024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59412024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
59422024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59432024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59442024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
59452024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
59462024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59472024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
59482024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
59492024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59502024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59512024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
59522024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
59532024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59542024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
59552024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59562024-11-14T04:51:15.309ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59572024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59582024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
59592024-11-14T04:51:15.309ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
59602024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59612024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
59622024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
59632024-11-14T04:51:15.309ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59642024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59652024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59662024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
59672024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59682024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
59692024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59702024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
59712024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
59722024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
59732024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
59742024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
59752024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
59762024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59772024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
59782024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
59792024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59802024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59812024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
59822024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
59832024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
59842024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
59852024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
59862024-11-14T04:51:15.309ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
59872024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.47\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
59882024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
59892024-11-14T04:51:15.309ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
59902024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59912024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59922024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
59932024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59942024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
59952024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59962024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59972024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59982024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59992024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60002024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60012024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60022024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60032024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60042024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60052024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60062024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60072024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60082024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60092024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60102024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60112024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60122024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60132024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60142024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60152024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60162024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60172024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60182024-11-14T04:51:15.310ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 83989030 } })
60192024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60202024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60212024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60222024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60232024-11-14T04:51:15.310ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 84037531 } })
60242024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
60252024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 933.248\u{b5}s iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
60262024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
60272024-11-14T04:51:15.310ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.196894ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
60282024-11-14T04:51:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60292024-11-14T04:51:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60302024-11-14T04:51:15.313ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 87057529 } })
60312024-11-14T04:51:15.313ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
60322024-11-14T04:51:15.313ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:41:15.309179854 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
60332024-11-14T04:51:15.313ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.410427ms iteration = 6 status = {"expiration":"2024-11-14T04:41:15.309179854Z","pruned":[]}
60342024-11-14T04:51:15.313ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.16071ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60352024-11-14T04:51:15.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60362024-11-14T04:51:15.314ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60372024-11-14T04:51:15.314ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60382024-11-14T04:51:15.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60392024-11-14T04:51:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60402024-11-14T04:51:15.314ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60412024-11-14T04:51:15.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60422024-11-14T04:51:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60432024-11-14T04:51:15.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60442024-11-14T04:51:15.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60452024-11-14T04:51:15.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
60462024-11-14T04:51:15.317ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
60472024-11-14T04:51:15.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60482024-11-14T04:51:15.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60492024-11-14T04:51:15.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60502024-11-14T04:51:15.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60512024-11-14T04:51:15.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60522024-11-14T04:51:15.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60532024-11-14T04:51:15.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60542024-11-14T04:51:15.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60552024-11-14T04:51:15.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60562024-11-14T04:51:15.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60572024-11-14T04:51:15.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60582024-11-14T04:51:15.324ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60592024-11-14T04:51:15.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60602024-11-14T04:51:15.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60612024-11-14T04:51:15.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60622024-11-14T04:51:15.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60632024-11-14T04:51:15.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60642024-11-14T04:51:15.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60652024-11-14T04:51:15.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60662024-11-14T04:51:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60672024-11-14T04:51:15.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60682024-11-14T04:51:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60692024-11-14T04:51:15.328ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 102418054 } })
60702024-11-14T04:51:15.329ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
60712024-11-14T04:51:15.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60722024-11-14T04:51:15.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60732024-11-14T04:51:15.331ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.583165ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
60742024-11-14T04:51:15.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60752024-11-14T04:51:15.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60762024-11-14T04:51:15.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60772024-11-14T04:51:15.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60782024-11-14T04:51:15.338ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60792024-11-14T04:51:15.338ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60802024-11-14T04:51:15.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60812024-11-14T04:51:15.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60822024-11-14T04:51:15.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60832024-11-14T04:51:15.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60842024-11-14T04:51:15.341ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1254, tv_nsec: 115522043 } })
60852024-11-14T04:51:15.342ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
60862024-11-14T04:51:15.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60872024-11-14T04:51:15.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60882024-11-14T04:51:15.383ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
60892024-11-14T04:51:15.383ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
60902024-11-14T04:51:15.383ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.133397ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
60912024-11-14T04:51:15.384ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60922024-11-14T04:51:15.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60932024-11-14T04:51:15.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60942024-11-14T04:51:15.386ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60952024-11-14T04:51:15.388ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60962024-11-14T04:51:15.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60972024-11-14T04:51:15.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60982024-11-14T04:51:15.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60992024-11-14T04:51:15.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61002024-11-14T04:51:15.390ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61012024-11-14T04:51:15.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61022024-11-14T04:51:15.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61032024-11-14T04:51:15.392ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61042024-11-14T04:51:15.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61052024-11-14T04:51:15.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61062024-11-14T04:51:15.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61072024-11-14T04:51:15.400ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61082024-11-14T04:51:15.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61092024-11-14T04:51:15.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61102024-11-14T04:51:15.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61112024-11-14T04:51:15.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61122024-11-14T04:51:15.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61132024-11-14T04:51:15.408ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61142024-11-14T04:51:15.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61152024-11-14T04:51:15.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 99.979026ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
61162024-11-14T04:51:15.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61172024-11-14T04:51:15.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61182024-11-14T04:51:15.413ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61192024-11-14T04:51:15.413ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61202024-11-14T04:51:15.413ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61212024-11-14T04:51:15.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61222024-11-14T04:51:15.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
61232024-11-14T04:51:15.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61242024-11-14T04:51:15.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61252024-11-14T04:51:15.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61262024-11-14T04:51:15.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 114.538928ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
61272024-11-14T04:51:15.429ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61282024-11-14T04:51:15.429ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61292024-11-14T04:51:15.429ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.284443ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61302024-11-14T04:51:15.431ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61312024-11-14T04:51:15.431ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 121.88972ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61322024-11-14T04:51:15.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.107546ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61332024-11-14T04:51:15.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61342024-11-14T04:51:15.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61352024-11-14T04:51:15.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61362024-11-14T04:51:15.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61372024-11-14T04:51:15.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61382024-11-14T04:51:15.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61392024-11-14T04:51:15.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61402024-11-14T04:51:15.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61412024-11-14T04:51:15.467ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
61422024-11-14T04:51:15.467ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 157.938673ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
61432024-11-14T04:51:15.480ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61442024-11-14T04:51:15.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61452024-11-14T04:51:15.481ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61462024-11-14T04:51:15.481ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61472024-11-14T04:51:15.481ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61482024-11-14T04:51:15.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61492024-11-14T04:51:15.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61502024-11-14T04:51:15.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 174.484983ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61512024-11-14T04:51:15.489ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61522024-11-14T04:51:15.489ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61532024-11-14T04:51:15.489ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 180.361423ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61542024-11-14T04:51:15.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 180.416465ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
61552024-11-14T04:51:15.492ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61562024-11-14T04:51:15.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61572024-11-14T04:51:15.497ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61582024-11-14T04:51:15.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
61592024-11-14T04:51:15.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61602024-11-14T04:51:15.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61612024-11-14T04:51:15.514ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61622024-11-14T04:51:15.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61632024-11-14T04:51:15.522ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
61642024-11-14T04:51:15.532ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61652024-11-14T04:51:15.532ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61662024-11-14T04:51:15.532ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61672024-11-14T04:51:15.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61682024-11-14T04:51:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61692024-11-14T04:51:15.538ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
61702024-11-14T04:51:15.538ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61712024-11-14T04:51:15.538ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfb9ed3e-b109-4869-99e2-8d6b2c60717d", "content-length": "26", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
61722024-11-14T04:51:15.538ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61732024-11-14T04:51:15.541ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61742024-11-14T04:51:15.551ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61752024-11-14T04:51:15.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61762024-11-14T04:51:15.568ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
61772024-11-14T04:51:15.572ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 263.652615ms iteration = 13 status = {"physical_disks_added":0}
61782024-11-14T04:51:15.588ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
61792024-11-14T04:51:15.588ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61802024-11-14T04:51:15.590ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afd90829-499b-4d9f-b2bc-943e58063591", "content-length": "26", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
61812024-11-14T04:51:15.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61822024-11-14T04:51:15.594ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61832024-11-14T04:51:15.655ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61842024-11-14T04:51:15.655ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61852024-11-14T04:51:15.656ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae8cf38d-8434-4c55-a2a6-fc18e55aef8f", "content-length": "372", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
61862024-11-14T04:51:15.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61872024-11-14T04:51:15.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61882024-11-14T04:51:15.660ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 351.149489ms iteration = 11 status = 0
61892024-11-14T04:51:15.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61902024-11-14T04:51:15.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61912024-11-14T04:51:15.693ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61922024-11-14T04:51:15.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61932024-11-14T04:51:15.694ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61942024-11-14T04:51:15.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61952024-11-14T04:51:15.695ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "76c2fa71-8eaa-497b-b7eb-fe56d6e94667", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61962024-11-14T04:51:15.695ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61972024-11-14T04:51:15.696ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b82028dd-5151-4b10-9156-396ba11fcfa6", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61982024-11-14T04:51:15.696ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
61992024-11-14T04:51:15.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 387.310656ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62002024-11-14T04:51:15.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
62012024-11-14T04:51:15.697ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62022024-11-14T04:51:15.697ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66c331bd-ff64-4e4f-aea9-f42de4386c77", "content-length": "26", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
62032024-11-14T04:51:15.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62042024-11-14T04:51:15.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62052024-11-14T04:51:15.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62062024-11-14T04:51:15.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62072024-11-14T04:51:15.698ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
62082024-11-14T04:51:15.698ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 389.602513ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62092024-11-14T04:51:15.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62102024-11-14T04:51:15.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
62112024-11-14T04:51:15.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62122024-11-14T04:51:15.703ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 394.022131ms iteration = 11 status = {}
62132024-11-14T04:51:15.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62142024-11-14T04:51:15.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62152024-11-14T04:51:15.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62162024-11-14T04:51:15.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62172024-11-14T04:51:15.724ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
62182024-11-14T04:51:15.724ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62192024-11-14T04:51:15.724ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5f0a9be3-ba7e-47d4-b33b-5868856f61e1", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
62202024-11-14T04:51:15.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62212024-11-14T04:51:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62222024-11-14T04:51:15.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62232024-11-14T04:51:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62242024-11-14T04:51:15.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62252024-11-14T04:51:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62262024-11-14T04:51:15.733ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62272024-11-14T04:51:15.733ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 424.221735ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62282024-11-14T04:51:15.735ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62292024-11-14T04:51:15.735ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62302024-11-14T04:51:15.736ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6450ebbe-b284-49bf-9e24-5bcdd5d7ccdf", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
62312024-11-14T04:51:15.738ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 428.624053ms iteration = 11 status = {}
62322024-11-14T04:51:15.743ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62332024-11-14T04:51:15.743ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
62342024-11-14T04:51:15.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62352024-11-14T04:51:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62362024-11-14T04:51:15.747ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62372024-11-14T04:51:15.747ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62382024-11-14T04:51:15.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62392024-11-14T04:51:15.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62402024-11-14T04:51:15.748ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
62412024-11-14T04:51:15.748ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 438.407575ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62422024-11-14T04:51:15.749ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62432024-11-14T04:51:15.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62442024-11-14T04:51:15.750ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62452024-11-14T04:51:15.751ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c670ada-f190-4a2f-af63-6557387393ff", "content-length": "1", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
62462024-11-14T04:51:15.753ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62472024-11-14T04:51:15.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62482024-11-14T04:51:15.754ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62492024-11-14T04:51:15.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62502024-11-14T04:51:15.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62512024-11-14T04:51:15.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62522024-11-14T04:51:15.755ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 445.974015ms iteration = 11 status = null
62532024-11-14T04:51:15.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62542024-11-14T04:51:15.758ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62552024-11-14T04:51:15.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62562024-11-14T04:51:15.761ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62572024-11-14T04:51:15.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62582024-11-14T04:51:15.766ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62592024-11-14T04:51:15.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62602024-11-14T04:51:15.767ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62612024-11-14T04:51:15.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62622024-11-14T04:51:15.771ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62632024-11-14T04:51:15.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62642024-11-14T04:51:15.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62652024-11-14T04:51:15.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62662024-11-14T04:51:15.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62672024-11-14T04:51:15.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62682024-11-14T04:51:15.786ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62692024-11-14T04:51:15.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62702024-11-14T04:51:15.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62712024-11-14T04:51:15.788ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62722024-11-14T04:51:15.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62732024-11-14T04:51:15.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62742024-11-14T04:51:15.789ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
62752024-11-14T04:51:15.789ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62762024-11-14T04:51:15.789ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
62772024-11-14T04:51:15.789ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 479.396633ms iteration = 6 status = {"generation":2}
62782024-11-14T04:51:15.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62792024-11-14T04:51:15.790ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62802024-11-14T04:51:15.790ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62812024-11-14T04:51:15.790ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
62822024-11-14T04:51:15.790ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 481.107952ms iteration = 6 status = {"generation":1}
62832024-11-14T04:51:15.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62842024-11-14T04:51:15.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62852024-11-14T04:51:15.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62862024-11-14T04:51:15.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62872024-11-14T04:51:15.814ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d81d111d-ec7d-4dfa-b811-1ee5ac1817d3", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62882024-11-14T04:51:15.814ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62892024-11-14T04:51:15.817ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "271e69f0-3b86-496e-8c71-eae80ad1cf1a", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62902024-11-14T04:51:15.817ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62912024-11-14T04:51:15.819ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b3f7fec9-2bbb-4ec4-9051-cbad1999271e", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62922024-11-14T04:51:15.819ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62932024-11-14T04:51:15.821ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
62942024-11-14T04:51:15.821ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 511.715748ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62952024-11-14T04:51:15.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62962024-11-14T04:51:15.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62972024-11-14T04:51:15.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62982024-11-14T04:51:15.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62992024-11-14T04:51:15.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63002024-11-14T04:51:15.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63012024-11-14T04:51:15.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63022024-11-14T04:51:15.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63032024-11-14T04:51:15.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63042024-11-14T04:51:15.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63052024-11-14T04:51:15.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63062024-11-14T04:51:15.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63072024-11-14T04:51:15.930ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63082024-11-14T04:51:15.930ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "edc60807-f1c3-4fe1-aba8-8839bb186504", "content-length": "691", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
63092024-11-14T04:51:15.930ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63102024-11-14T04:51:15.930ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63112024-11-14T04:51:15.930ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63122024-11-14T04:51:15.932ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63132024-11-14T04:51:15.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63142024-11-14T04:51:15.933ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 624.135854ms iteration = 11 status = {}
63152024-11-14T04:51:15.936ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
63162024-11-14T04:51:15.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63172024-11-14T04:51:15.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63182024-11-14T04:51:15.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63192024-11-14T04:51:15.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb1391f2-99f6-4677-ac43-6d6b16a97ec7", "content-length": "134", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
63202024-11-14T04:51:15.949ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63212024-11-14T04:51:15.949ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
63222024-11-14T04:51:15.949ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63232024-11-14T04:51:15.950ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63242024-11-14T04:51:15.950ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63252024-11-14T04:51:15.950ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63262024-11-14T04:51:15.950ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63272024-11-14T04:51:15.950ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63282024-11-14T04:51:15.950ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63292024-11-14T04:51:15.950ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63302024-11-14T04:51:15.950ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
63312024-11-14T04:51:15.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63322024-11-14T04:51:15.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63332024-11-14T04:51:15.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63342024-11-14T04:51:15.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63352024-11-14T04:51:15.955ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e20dcd7-1ae9-4637-ba79-86ba917ed3a9", "content-length": "2", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
63362024-11-14T04:51:15.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63372024-11-14T04:51:15.955ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7059a3cc-4610-423d-bb7f-916602f55504", "content-length": "51", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
63382024-11-14T04:51:15.956ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
63392024-11-14T04:51:15.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63402024-11-14T04:51:15.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
63412024-11-14T04:51:15.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63422024-11-14T04:51:15.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63432024-11-14T04:51:15.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63442024-11-14T04:51:15.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63452024-11-14T04:51:15.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63462024-11-14T04:51:15.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63472024-11-14T04:51:15.964ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63482024-11-14T04:51:15.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63492024-11-14T04:51:15.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63502024-11-14T04:51:15.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63512024-11-14T04:51:15.969ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63522024-11-14T04:51:15.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63532024-11-14T04:51:15.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63542024-11-14T04:51:15.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63552024-11-14T04:51:15.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63562024-11-14T04:51:15.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63572024-11-14T04:51:15.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63582024-11-14T04:51:15.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63592024-11-14T04:51:15.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63602024-11-14T04:51:15.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63612024-11-14T04:51:15.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63622024-11-14T04:51:15.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63632024-11-14T04:51:15.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63642024-11-14T04:51:15.984ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63652024-11-14T04:51:15.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63662024-11-14T04:51:15.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63672024-11-14T04:51:15.990ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63682024-11-14T04:51:15.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63692024-11-14T04:51:15.992ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63702024-11-14T04:51:15.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63712024-11-14T04:51:15.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63722024-11-14T04:51:15.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63732024-11-14T04:51:15.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63742024-11-14T04:51:15.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63752024-11-14T04:51:16.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63762024-11-14T04:51:16.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63772024-11-14T04:51:16.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63782024-11-14T04:51:16.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63792024-11-14T04:51:16.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63802024-11-14T04:51:16.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63812024-11-14T04:51:16.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63822024-11-14T04:51:16.007ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
63832024-11-14T04:51:16.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63842024-11-14T04:51:16.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63852024-11-14T04:51:16.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63862024-11-14T04:51:16.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63872024-11-14T04:51:16.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63882024-11-14T04:51:16.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63892024-11-14T04:51:16.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63902024-11-14T04:51:16.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
63912024-11-14T04:51:16.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63922024-11-14T04:51:16.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63932024-11-14T04:51:16.029ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 32de9250-63c9-46be-9a6b-ee4af19ab1ab, kind: Service { id: 48221b8a-d832-4d05-ae47-e92f81388c0c }, name: Name("external-dns-48221b8a-d832-4d05-ae47-e92f81388c0c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 126])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da2f10b4-11b4-4931-a7f7-d415353256ec, kind: Service { id: 8c0d54f6-76b3-47cc-9828-b8e677cc2961 }, name: Name("external-dns-8c0d54f6-76b3-47cc-9828-b8e677cc2961"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 68cb12a7-f65f-4940-ad7a-12ac0e8fa220, kind: Service { id: 7d1b51fe-adf1-4350-9c25-9240054e3911 }, name: Name("nexus-7d1b51fe-adf1-4350-9c25-9240054e3911"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5946ca8-a389-4a86-aed2-97d4e8639c67, kind: Service { id: 13db289d-f9b6-41e9-b3bd-5ab4f3105694 }, name: Name("nexus-13db289d-f9b6-41e9-b3bd-5ab4f3105694"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b897d57d-b436-467c-89e9-441e43e441fa, kind: Service { id: 79994e02-6747-4071-83af-7872b31640fb }, name: Name("nexus-79994e02-6747-4071-83af-7872b31640fb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
63942024-11-14T04:51:16.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63952024-11-14T04:51:16.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63962024-11-14T04:51:16.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63972024-11-14T04:51:16.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
63982024-11-14T04:51:16.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63992024-11-14T04:51:16.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64002024-11-14T04:51:16.035ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
64012024-11-14T04:51:16.037ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32de9250-63c9-46be-9a6b-ee4af19ab1ab, kind: Service { id: 48221b8a-d832-4d05-ae47-e92f81388c0c }, name: Name("external-dns-48221b8a-d832-4d05-ae47-e92f81388c0c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 126])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da2f10b4-11b4-4931-a7f7-d415353256ec, kind: Service { id: 8c0d54f6-76b3-47cc-9828-b8e677cc2961 }, name: Name("external-dns-8c0d54f6-76b3-47cc-9828-b8e677cc2961"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 68cb12a7-f65f-4940-ad7a-12ac0e8fa220, kind: Service { id: 7d1b51fe-adf1-4350-9c25-9240054e3911 }, name: Name("nexus-7d1b51fe-adf1-4350-9c25-9240054e3911"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5946ca8-a389-4a86-aed2-97d4e8639c67, kind: Service { id: 13db289d-f9b6-41e9-b3bd-5ab4f3105694 }, name: Name("nexus-13db289d-f9b6-41e9-b3bd-5ab4f3105694"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b897d57d-b436-467c-89e9-441e43e441fa, kind: Service { id: 79994e02-6747-4071-83af-7872b31640fb }, name: Name("nexus-79994e02-6747-4071-83af-7872b31640fb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
64022024-11-14T04:51:16.037ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
64032024-11-14T04:51:16.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94ce1d5d-57d7-4891-8fdd-928d88c93f9d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64042024-11-14T04:51:16.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94ce1d5d-57d7-4891-8fdd-928d88c93f9d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64052024-11-14T04:51:16.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94ce1d5d-57d7-4891-8fdd-928d88c93f9d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64062024-11-14T04:51:16.108ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c073d51c-abaa-48df-abb6-2f053e9c1bec, time_created: 2024-11-14T04:46:13.572725Z, time_modified: 2024-11-14T04:46:13.572725Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f971eb12-0fea-4084-96d3-74198bddd289, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
64072024-11-14T04:51:16.108ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
64082024-11-14T04:51:16.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64092024-11-14T04:51:16.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64102024-11-14T04:51:16.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64112024-11-14T04:51:16.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64122024-11-14T04:51:16.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64132024-11-14T04:51:16.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
64142024-11-14T04:51:16.150ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
64152024-11-14T04:51:16.151ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "f6bfe9e8-e002-4aad-8f9a-ef3a56e27855", "date": "Thu, 14 Nov 2024 04:51:16 GMT"} })
64162024-11-14T04:51:16.152ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
64172024-11-14T04:51:16.152ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 842.822556ms
64182024-11-14T04:51:16.152ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 842.836246ms iteration = 2 status = {}
64192024-11-14T04:51:16.180ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f72c8cf4-3680-46da-b293-71e6e2a945da", "date": "Thu, 14 Nov 2024 04:51:15 GMT"} })
64202024-11-14T04:51:16.181ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
64212024-11-14T04:51:16.181ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64222024-11-14T04:51:16.186ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b1c2943-b827-4441-aa4a-2b8842785194", "content-length": "682", "date": "Thu, 14 Nov 2024 04:51:16 GMT"} })
64232024-11-14T04:51:16.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64242024-11-14T04:51:16.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64252024-11-14T04:51:16.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64262024-11-14T04:51:16.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64272024-11-14T04:51:16.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64282024-11-14T04:51:16.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64292024-11-14T04:51:16.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64302024-11-14T04:51:16.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64312024-11-14T04:51:16.206ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 897.126219ms iteration = 11 status = {}
64322024-11-14T04:51:16.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d27c6cea-42f4-447d-88cc-d5fa805ab1aa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64332024-11-14T04:51:16.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d27c6cea-42f4-447d-88cc-d5fa805ab1aa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64342024-11-14T04:51:16.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d27c6cea-42f4-447d-88cc-d5fa805ab1aa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64352024-11-14T04:51:17.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bccfdff8-8023-4ec2-b900-3e1e9de78699 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64362024-11-14T04:51:17.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bccfdff8-8023-4ec2-b900-3e1e9de78699 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64372024-11-14T04:51:17.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bccfdff8-8023-4ec2-b900-3e1e9de78699 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64382024-11-14T04:51:18.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e61e48da-9d43-4296-9875-747e0dc3d7e1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64392024-11-14T04:51:18.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e61e48da-9d43-4296-9875-747e0dc3d7e1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64402024-11-14T04:51:18.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e61e48da-9d43-4296-9875-747e0dc3d7e1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64412024-11-14T04:51:19.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ef9a739-5ed0-47a6-8da8-9681ee3c1f53 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64422024-11-14T04:51:19.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ef9a739-5ed0-47a6-8da8-9681ee3c1f53 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64432024-11-14T04:51:19.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ef9a739-5ed0-47a6-8da8-9681ee3c1f53 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64442024-11-14T04:51:20.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce415c5d-a810-4fad-af79-2ff7eaf65911 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64452024-11-14T04:51:20.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce415c5d-a810-4fad-af79-2ff7eaf65911 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64462024-11-14T04:51:20.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce415c5d-a810-4fad-af79-2ff7eaf65911 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64472024-11-14T04:51:20.259ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 501 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 18f5ff77-f4e8-41ec-be01-f0b9489859ea response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
64482024-11-14T04:51:21.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 34f586ea-2d97-4bd7-ad4a-8de704de21a8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64492024-11-14T04:51:21.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 34f586ea-2d97-4bd7-ad4a-8de704de21a8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64502024-11-14T04:51:21.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 34f586ea-2d97-4bd7-ad4a-8de704de21a8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64512024-11-14T04:51:22.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 563752b9-2705-4226-9b08-a9c9922deead roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64522024-11-14T04:51:22.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 563752b9-2705-4226-9b08-a9c9922deead resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64532024-11-14T04:51:22.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 563752b9-2705-4226-9b08-a9c9922deead response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64542024-11-14T04:51:23.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = af5dcd14-d60e-4237-bb13-44033f156026 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64552024-11-14T04:51:23.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = af5dcd14-d60e-4237-bb13-44033f156026 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64562024-11-14T04:51:23.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = af5dcd14-d60e-4237-bb13-44033f156026 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64572024-11-14T04:51:24.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dcca1f01-454a-444c-a6dd-e2bac2235b49 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64582024-11-14T04:51:24.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dcca1f01-454a-444c-a6dd-e2bac2235b49 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64592024-11-14T04:51:24.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dcca1f01-454a-444c-a6dd-e2bac2235b49 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64602024-11-14T04:51:25.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2b0200cb-785c-426c-a9f3-4d6e43e7dbfb roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
64612024-11-14T04:51:25.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2b0200cb-785c-426c-a9f3-4d6e43e7dbfb resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
64622024-11-14T04:51:25.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = 2b0200cb-785c-426c-a9f3-4d6e43e7dbfb response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
64632024-11-14T04:51:25.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = ed445615-f217-4d84-87a2-58ede3a2c4f4 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
64642024-11-14T04:51:25.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = ed445615-f217-4d84-87a2-58ede3a2c4f4 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
64652024-11-14T04:51:25.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59723 req_id = ed445615-f217-4d84-87a2-58ede3a2c4f4 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
64662024-11-14T04:51:25.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58ccffc8-5604-4599-8670-d0b0cfc03822 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64672024-11-14T04:51:25.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58ccffc8-5604-4599-8670-d0b0cfc03822 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64682024-11-14T04:51:25.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58ccffc8-5604-4599-8670-d0b0cfc03822 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64692024-11-14T04:51:25.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
64702024-11-14T04:51:25.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64712024-11-14T04:51:25.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
64722024-11-14T04:51:25.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64732024-11-14T04:51:25.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64742024-11-14T04:51:25.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64752024-11-14T04:51:25.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64762024-11-14T04:51:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64772024-11-14T04:51:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64782024-11-14T04:51:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64792024-11-14T04:51:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64802024-11-14T04:51:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64812024-11-14T04:51:25.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64822024-11-14T04:51:25.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
64832024-11-14T04:51:25.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64842024-11-14T04:51:25.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64852024-11-14T04:51:25.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
64862024-11-14T04:51:25.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.532294ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
64872024-11-14T04:51:25.336ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64882024-11-14T04:51:25.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64892024-11-14T04:51:25.338ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.381591ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64902024-11-14T04:51:26.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 36ffa2aa-fc8a-4520-8088-baf2fac56dca roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64912024-11-14T04:51:26.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 36ffa2aa-fc8a-4520-8088-baf2fac56dca resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64922024-11-14T04:51:26.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 36ffa2aa-fc8a-4520-8088-baf2fac56dca response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64932024-11-14T04:51:27.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ccca478-1045-4e44-aed7-3528ad97f028 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64942024-11-14T04:51:27.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ccca478-1045-4e44-aed7-3528ad97f028 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64952024-11-14T04:51:27.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ccca478-1045-4e44-aed7-3528ad97f028 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64962024-11-14T04:51:28.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 62d27fa5-df8c-4469-a1ba-463a00897184 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64972024-11-14T04:51:28.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 62d27fa5-df8c-4469-a1ba-463a00897184 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64982024-11-14T04:51:28.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 62d27fa5-df8c-4469-a1ba-463a00897184 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
64992024-11-14T04:51:29.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6497ced5-9748-4300-bec9-21968dcf0424 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65002024-11-14T04:51:29.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6497ced5-9748-4300-bec9-21968dcf0424 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65012024-11-14T04:51:29.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6497ced5-9748-4300-bec9-21968dcf0424 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65022024-11-14T04:51:30.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = af5bdc1b-7a2f-4959-9e7d-5e140f9e87de roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65032024-11-14T04:51:30.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = af5bdc1b-7a2f-4959-9e7d-5e140f9e87de resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65042024-11-14T04:51:30.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = af5bdc1b-7a2f-4959-9e7d-5e140f9e87de response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65052024-11-14T04:51:31.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 996c8167-9afd-415e-8b15-6b45b474e3f8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65062024-11-14T04:51:31.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 996c8167-9afd-415e-8b15-6b45b474e3f8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65072024-11-14T04:51:31.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 996c8167-9afd-415e-8b15-6b45b474e3f8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65082024-11-14T04:51:32.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1534f81c-f539-4810-98bb-cebdf8570bc2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65092024-11-14T04:51:32.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1534f81c-f539-4810-98bb-cebdf8570bc2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65102024-11-14T04:51:32.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1534f81c-f539-4810-98bb-cebdf8570bc2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65112024-11-14T04:51:33.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aae42e9e-6b14-45a0-aceb-008043a0b183 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65122024-11-14T04:51:33.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aae42e9e-6b14-45a0-aceb-008043a0b183 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65132024-11-14T04:51:33.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aae42e9e-6b14-45a0-aceb-008043a0b183 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65142024-11-14T04:51:34.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff63c34d-7a77-4c68-ae52-b6f7df7f3644 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65152024-11-14T04:51:34.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff63c34d-7a77-4c68-ae52-b6f7df7f3644 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65162024-11-14T04:51:34.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ff63c34d-7a77-4c68-ae52-b6f7df7f3644 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65172024-11-14T04:51:35.261ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 678 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 0845cd6c-5df4-4d21-9919-fe51477510f9 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
65182024-11-14T04:51:35.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
65192024-11-14T04:51:35.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
65202024-11-14T04:51:35.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65212024-11-14T04:51:35.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65222024-11-14T04:51:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65232024-11-14T04:51:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65242024-11-14T04:51:35.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65252024-11-14T04:51:35.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65262024-11-14T04:51:35.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65272024-11-14T04:51:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65282024-11-14T04:51:35.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65292024-11-14T04:51:35.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65302024-11-14T04:51:35.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65312024-11-14T04:51:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65322024-11-14T04:51:35.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65332024-11-14T04:51:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
65342024-11-14T04:51:35.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65352024-11-14T04:51:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65362024-11-14T04:51:35.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
65372024-11-14T04:51:35.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.988056ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
65382024-11-14T04:51:35.345ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.761995ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65392024-11-14T04:51:35.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5770e2c4-46c9-4d94-af97-4c309d6d10e0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65402024-11-14T04:51:35.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5770e2c4-46c9-4d94-af97-4c309d6d10e0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65412024-11-14T04:51:35.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5770e2c4-46c9-4d94-af97-4c309d6d10e0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65422024-11-14T04:51:36.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8195b7fa-ffbe-48a6-a135-9083088103c6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65432024-11-14T04:51:36.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8195b7fa-ffbe-48a6-a135-9083088103c6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65442024-11-14T04:51:36.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8195b7fa-ffbe-48a6-a135-9083088103c6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65452024-11-14T04:51:37.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c4780a15-2f87-4fb6-8810-ce1605b56c4f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65462024-11-14T04:51:37.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c4780a15-2f87-4fb6-8810-ce1605b56c4f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65472024-11-14T04:51:37.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c4780a15-2f87-4fb6-8810-ce1605b56c4f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65482024-11-14T04:51:38.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e4da62d-a563-4c09-9bc4-e69b41e24496 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65492024-11-14T04:51:38.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e4da62d-a563-4c09-9bc4-e69b41e24496 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65502024-11-14T04:51:38.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e4da62d-a563-4c09-9bc4-e69b41e24496 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65512024-11-14T04:51:39.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 449ba550-fdae-4c6e-9386-f48070c77430 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65522024-11-14T04:51:39.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 449ba550-fdae-4c6e-9386-f48070c77430 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65532024-11-14T04:51:39.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 449ba550-fdae-4c6e-9386-f48070c77430 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65542024-11-14T04:51:40.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f03cd6fb-3817-42ab-af90-b719c8dc4b46 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65552024-11-14T04:51:40.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f03cd6fb-3817-42ab-af90-b719c8dc4b46 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65562024-11-14T04:51:40.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f03cd6fb-3817-42ab-af90-b719c8dc4b46 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65572024-11-14T04:51:41.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cc78ab8f-66bb-40ba-a868-52fe05fce25f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65582024-11-14T04:51:41.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cc78ab8f-66bb-40ba-a868-52fe05fce25f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65592024-11-14T04:51:41.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cc78ab8f-66bb-40ba-a868-52fe05fce25f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65602024-11-14T04:51:42.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b04641cc-b338-49f1-a557-cf1e4f6e2534 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65612024-11-14T04:51:42.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b04641cc-b338-49f1-a557-cf1e4f6e2534 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65622024-11-14T04:51:42.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b04641cc-b338-49f1-a557-cf1e4f6e2534 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65632024-11-14T04:51:43.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6517371c-88d3-4901-903e-2431081bccdc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65642024-11-14T04:51:43.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6517371c-88d3-4901-903e-2431081bccdc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65652024-11-14T04:51:43.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6517371c-88d3-4901-903e-2431081bccdc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65662024-11-14T04:51:44.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef5942aa-6e4a-4c9a-b13f-2e123535fa86 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65672024-11-14T04:51:44.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef5942aa-6e4a-4c9a-b13f-2e123535fa86 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65682024-11-14T04:51:44.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef5942aa-6e4a-4c9a-b13f-2e123535fa86 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
65692024-11-14T04:51:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
65702024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65712024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
65722024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
65732024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65742024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
65752024-11-14T04:51:45.309ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65762024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
65772024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65782024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65792024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65802024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
65812024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
65822024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65832024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
65842024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65852024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
65862024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
65872024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65882024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65892024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
65902024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65912024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
65922024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65932024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
65942024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65952024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
65962024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65972024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
65982024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65992024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
66002024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66012024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
66022024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66032024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66042024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66052024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66062024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66072024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66082024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66092024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66102024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66112024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66122024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66132024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66142024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66152024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66162024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66172024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66182024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66192024-11-14T04:51:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66202024-11-14T04:51:45.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.538163ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
66212024-11-14T04:51:45.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66222024-11-14T04:51:45.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66232024-11-14T04:51:45.312ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.46394ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66242024-11-14T04:51:45.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66252024-11-14T04:51:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66262024-11-14T04:51:45.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66272024-11-14T04:51:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66282024-11-14T04:51:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66292024-11-14T04:51:45.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66302024-11-14T04:51:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66312024-11-14T04:51:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66322024-11-14T04:51:45.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66332024-11-14T04:51:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66342024-11-14T04:51:45.317ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 91026692 } })
66352024-11-14T04:51:45.317ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 91188176 } })
66362024-11-14T04:51:45.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
66372024-11-14T04:51:45.317ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
66382024-11-14T04:51:45.323ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66392024-11-14T04:51:45.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66402024-11-14T04:51:45.327ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1284, tv_nsec: 101505185 } })
66412024-11-14T04:51:45.327ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
66422024-11-14T04:51:45.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66432024-11-14T04:51:45.367ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66442024-11-14T04:51:45.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66452024-11-14T04:51:45.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66462024-11-14T04:51:45.371ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66472024-11-14T04:51:45.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66482024-11-14T04:51:45.374ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66492024-11-14T04:51:45.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66502024-11-14T04:51:45.378ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66512024-11-14T04:51:45.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66522024-11-14T04:51:45.380ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66532024-11-14T04:51:45.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66542024-11-14T04:51:45.382ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66552024-11-14T04:51:45.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66562024-11-14T04:51:45.383ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66572024-11-14T04:51:45.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66582024-11-14T04:51:45.384ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66592024-11-14T04:51:45.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66602024-11-14T04:51:45.385ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66612024-11-14T04:51:45.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66622024-11-14T04:51:45.385ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66632024-11-14T04:51:45.385ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66642024-11-14T04:51:45.385ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66652024-11-14T04:51:45.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66662024-11-14T04:51:45.388ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 78.874054ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
66672024-11-14T04:51:45.389ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66682024-11-14T04:51:45.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66692024-11-14T04:51:45.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66702024-11-14T04:51:45.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66712024-11-14T04:51:45.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66722024-11-14T04:51:45.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66732024-11-14T04:51:45.415ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66742024-11-14T04:51:45.415ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.756632ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66752024-11-14T04:51:45.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66762024-11-14T04:51:45.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66772024-11-14T04:51:45.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66782024-11-14T04:51:45.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
66792024-11-14T04:51:45.423ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66802024-11-14T04:51:45.424ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1993cc2e-0f14-4f51-b495-853141b1db9d", "content-length": "26", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
66812024-11-14T04:51:45.424ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66822024-11-14T04:51:45.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
66832024-11-14T04:51:45.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
66842024-11-14T04:51:45.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66852024-11-14T04:51:45.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66862024-11-14T04:51:45.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66872024-11-14T04:51:45.433ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
66882024-11-14T04:51:45.433ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66892024-11-14T04:51:45.433ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76889f6c-088e-4638-9f6d-1dbb2d4b01bf", "content-length": "26", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
66902024-11-14T04:51:45.433ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66912024-11-14T04:51:45.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66922024-11-14T04:51:45.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66932024-11-14T04:51:45.434ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66942024-11-14T04:51:45.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66952024-11-14T04:51:45.435ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66962024-11-14T04:51:45.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66972024-11-14T04:51:45.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66982024-11-14T04:51:45.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66992024-11-14T04:51:45.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
67002024-11-14T04:51:45.440ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67012024-11-14T04:51:45.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022024-11-14T04:51:45.440ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b88b0bf8-bcb4-4c6f-b370-faaa7ce5c723", "content-length": "26", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67032024-11-14T04:51:45.440ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67042024-11-14T04:51:45.442ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67052024-11-14T04:51:45.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
67062024-11-14T04:51:45.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67072024-11-14T04:51:45.443ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
67082024-11-14T04:51:45.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.768033ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
67092024-11-14T04:51:45.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67102024-11-14T04:51:45.446ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 137.668087ms iteration = 12 status = 0
67112024-11-14T04:51:45.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 141.428896ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67122024-11-14T04:51:45.453ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67132024-11-14T04:51:45.453ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67142024-11-14T04:51:45.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67152024-11-14T04:51:45.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67162024-11-14T04:51:45.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 147.555843ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67172024-11-14T04:51:45.459ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 150.785327ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67182024-11-14T04:51:45.462ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67192024-11-14T04:51:45.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67202024-11-14T04:51:45.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67212024-11-14T04:51:45.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67222024-11-14T04:51:45.565ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 256.55021ms iteration = 12 status = {}
67232024-11-14T04:51:45.565ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 256.513128ms iteration = 14 status = {"physical_disks_added":0}
67242024-11-14T04:51:45.576ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67252024-11-14T04:51:45.576ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67262024-11-14T04:51:45.577ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "38a0d3b1-d1a6-4f4d-affa-af30769ab391", "content-length": "372", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67272024-11-14T04:51:45.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67282024-11-14T04:51:45.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67292024-11-14T04:51:45.613ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67302024-11-14T04:51:45.613ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67312024-11-14T04:51:45.613ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 303.90284ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67322024-11-14T04:51:45.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 304.56614ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67332024-11-14T04:51:45.615ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67342024-11-14T04:51:45.616ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "75f753cc-5f30-4f6f-9a2e-5ffc990c9387", "content-length": "1", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67352024-11-14T04:51:45.617ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67362024-11-14T04:51:45.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67372024-11-14T04:51:45.620ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 311.097729ms iteration = 12 status = null
67382024-11-14T04:51:45.624ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67392024-11-14T04:51:45.624ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67402024-11-14T04:51:45.625ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a6ece76d-479d-42a9-937d-79cc833ef250", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67412024-11-14T04:51:45.625ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67422024-11-14T04:51:45.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67432024-11-14T04:51:45.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67442024-11-14T04:51:45.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67452024-11-14T04:51:45.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67462024-11-14T04:51:45.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67472024-11-14T04:51:45.633ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67482024-11-14T04:51:45.633ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67492024-11-14T04:51:45.633ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f544277e-d422-4eb4-a53c-01f80f1d2cba", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67502024-11-14T04:51:45.636ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 326.985929ms iteration = 12 status = {}
67512024-11-14T04:51:45.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67522024-11-14T04:51:45.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67532024-11-14T04:51:45.681ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
67542024-11-14T04:51:45.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67552024-11-14T04:51:45.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67562024-11-14T04:51:45.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67572024-11-14T04:51:45.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67582024-11-14T04:51:45.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67592024-11-14T04:51:45.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67602024-11-14T04:51:45.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67612024-11-14T04:51:45.695ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
67622024-11-14T04:51:45.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67632024-11-14T04:51:45.695ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd93f45a-5c74-48b4-abe6-7047543fd7ad", "content-length": "134", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67642024-11-14T04:51:45.695ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
67652024-11-14T04:51:45.695ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
67662024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67672024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67682024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67692024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67702024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67712024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67722024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67732024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67742024-11-14T04:51:45.696ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
67752024-11-14T04:51:45.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67762024-11-14T04:51:45.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67772024-11-14T04:51:45.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67782024-11-14T04:51:45.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
67792024-11-14T04:51:45.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d17e68b5-7c2b-4d68-b0ed-e000eee7b725", "content-length": "2", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67802024-11-14T04:51:45.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
67812024-11-14T04:51:45.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "61eef86b-63f0-407a-a212-a0f9a0b8a869", "content-length": "51", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67822024-11-14T04:51:45.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67832024-11-14T04:51:45.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67842024-11-14T04:51:45.699ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
67852024-11-14T04:51:45.699ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67862024-11-14T04:51:45.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67872024-11-14T04:51:45.786ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67882024-11-14T04:51:45.798ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "00be316a-ddc6-4e56-973a-0f841f3e15ac", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67892024-11-14T04:51:45.798ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
67902024-11-14T04:51:45.798ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67912024-11-14T04:51:45.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bf402ba4-35dc-4dae-bb36-7ac3a286a51c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
67922024-11-14T04:51:45.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bf402ba4-35dc-4dae-bb36-7ac3a286a51c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
67932024-11-14T04:51:45.799ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "45f1c766-df9c-4169-8280-48031ec0c9d6", "content-length": "682", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67942024-11-14T04:51:45.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67952024-11-14T04:51:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67962024-11-14T04:51:45.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bf402ba4-35dc-4dae-bb36-7ac3a286a51c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
67972024-11-14T04:51:45.802ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "159ad54f-e712-4d72-8859-602839810a01", "content-length": "691", "date": "Thu, 14 Nov 2024 04:51:45 GMT"} })
67982024-11-14T04:51:45.802ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67992024-11-14T04:51:45.802ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68002024-11-14T04:51:45.802ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68012024-11-14T04:51:45.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68022024-11-14T04:51:45.803ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 494.680564ms iteration = 12 status = {}
68032024-11-14T04:51:45.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68042024-11-14T04:51:45.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68052024-11-14T04:51:45.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68062024-11-14T04:51:45.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68072024-11-14T04:51:45.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68082024-11-14T04:51:45.817ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 507.955839ms iteration = 12 status = {}
68092024-11-14T04:51:46.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 8675fbce-aab2-485d-b3b7-860be6569753 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
68102024-11-14T04:51:46.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 8675fbce-aab2-485d-b3b7-860be6569753 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
68112024-11-14T04:51:46.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 8675fbce-aab2-485d-b3b7-860be6569753 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
68122024-11-14T04:51:46.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15653942-f801-49b7-bdb3-abef7bb4f3a5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68132024-11-14T04:51:46.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15653942-f801-49b7-bdb3-abef7bb4f3a5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68142024-11-14T04:51:46.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15653942-f801-49b7-bdb3-abef7bb4f3a5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68152024-11-14T04:51:47.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 568923e8-d28d-4713-930c-92ecb7d3d631 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68162024-11-14T04:51:47.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 568923e8-d28d-4713-930c-92ecb7d3d631 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68172024-11-14T04:51:47.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 568923e8-d28d-4713-930c-92ecb7d3d631 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68182024-11-14T04:51:48.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d6d20130-af9e-40ca-afb8-4501da7aef2f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68192024-11-14T04:51:48.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d6d20130-af9e-40ca-afb8-4501da7aef2f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68202024-11-14T04:51:48.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d6d20130-af9e-40ca-afb8-4501da7aef2f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68212024-11-14T04:51:49.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6bcb3999-23b0-4199-88a9-f6459c09fed4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68222024-11-14T04:51:49.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6bcb3999-23b0-4199-88a9-f6459c09fed4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68232024-11-14T04:51:49.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6bcb3999-23b0-4199-88a9-f6459c09fed4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68242024-11-14T04:51:50.260ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 849 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = f9643554-16e2-409c-87cd-5f86010fe7fd response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
68252024-11-14T04:51:50.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e8cd39bd-bf23-47f1-ba04-74f4b6a825e3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68262024-11-14T04:51:50.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e8cd39bd-bf23-47f1-ba04-74f4b6a825e3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68272024-11-14T04:51:50.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e8cd39bd-bf23-47f1-ba04-74f4b6a825e3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68282024-11-14T04:51:51.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ab38cb21-8392-45bb-a135-f36cffadf6d6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68292024-11-14T04:51:51.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ab38cb21-8392-45bb-a135-f36cffadf6d6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68302024-11-14T04:51:51.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ab38cb21-8392-45bb-a135-f36cffadf6d6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68312024-11-14T04:51:52.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f8fa410-3ee7-4bc8-8d20-38e312222864 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68322024-11-14T04:51:52.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f8fa410-3ee7-4bc8-8d20-38e312222864 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68332024-11-14T04:51:52.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f8fa410-3ee7-4bc8-8d20-38e312222864 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68342024-11-14T04:51:53.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 334ea5d1-1858-403c-ba94-7b0bb5081796 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68352024-11-14T04:51:53.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 334ea5d1-1858-403c-ba94-7b0bb5081796 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68362024-11-14T04:51:53.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 334ea5d1-1858-403c-ba94-7b0bb5081796 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68372024-11-14T04:51:55.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cdc1b07-fae9-4b7f-af68-e856d8a172e4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68382024-11-14T04:51:55.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cdc1b07-fae9-4b7f-af68-e856d8a172e4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68392024-11-14T04:51:55.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cdc1b07-fae9-4b7f-af68-e856d8a172e4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68402024-11-14T04:51:55.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
68412024-11-14T04:51:55.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
68422024-11-14T04:51:55.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68432024-11-14T04:51:55.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68442024-11-14T04:51:55.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68452024-11-14T04:51:55.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68462024-11-14T04:51:55.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68472024-11-14T04:51:55.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68482024-11-14T04:51:55.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68492024-11-14T04:51:55.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68502024-11-14T04:51:55.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68512024-11-14T04:51:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68522024-11-14T04:51:55.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68532024-11-14T04:51:55.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
68542024-11-14T04:51:55.320ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68552024-11-14T04:51:55.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68562024-11-14T04:51:55.332ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
68572024-11-14T04:51:55.332ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.978245ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
68582024-11-14T04:51:55.344ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68592024-11-14T04:51:55.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68602024-11-14T04:51:55.346ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.460524ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68612024-11-14T04:51:56.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a91195f-b236-4a71-be4d-11b22fb6a2ce roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68622024-11-14T04:51:56.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a91195f-b236-4a71-be4d-11b22fb6a2ce resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68632024-11-14T04:51:56.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a91195f-b236-4a71-be4d-11b22fb6a2ce response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68642024-11-14T04:51:57.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5c024a42-a2e1-40ea-9a72-517619c03087 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68652024-11-14T04:51:57.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5c024a42-a2e1-40ea-9a72-517619c03087 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68662024-11-14T04:51:57.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5c024a42-a2e1-40ea-9a72-517619c03087 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68672024-11-14T04:51:58.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 375e032a-5adf-4dc7-be87-0029c6d27a78 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68682024-11-14T04:51:58.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 375e032a-5adf-4dc7-be87-0029c6d27a78 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68692024-11-14T04:51:58.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 375e032a-5adf-4dc7-be87-0029c6d27a78 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68702024-11-14T04:51:59.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9a263084-9248-4b30-bc4c-ec2d83640034 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68712024-11-14T04:51:59.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9a263084-9248-4b30-bc4c-ec2d83640034 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68722024-11-14T04:51:59.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9a263084-9248-4b30-bc4c-ec2d83640034 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68732024-11-14T04:52:00.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9cbd81a-d4e8-41c0-9ca2-8f3728635cb1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68742024-11-14T04:52:00.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9cbd81a-d4e8-41c0-9ca2-8f3728635cb1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68752024-11-14T04:52:00.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9cbd81a-d4e8-41c0-9ca2-8f3728635cb1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68762024-11-14T04:52:01.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b939b378-a457-4b2f-90b3-2b0d3ee16e78 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68772024-11-14T04:52:01.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b939b378-a457-4b2f-90b3-2b0d3ee16e78 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68782024-11-14T04:52:01.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b939b378-a457-4b2f-90b3-2b0d3ee16e78 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68792024-11-14T04:52:02.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40fb672e-abb2-43f1-b9be-e2b007dacdb3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68802024-11-14T04:52:02.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40fb672e-abb2-43f1-b9be-e2b007dacdb3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68812024-11-14T04:52:02.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40fb672e-abb2-43f1-b9be-e2b007dacdb3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68822024-11-14T04:52:03.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f77dceba-c91c-4dfb-91c6-e44060b81f24 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68832024-11-14T04:52:03.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f77dceba-c91c-4dfb-91c6-e44060b81f24 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68842024-11-14T04:52:03.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f77dceba-c91c-4dfb-91c6-e44060b81f24 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68852024-11-14T04:52:04.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bb2337ea-af11-424d-adb7-4229a5ab333c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68862024-11-14T04:52:04.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bb2337ea-af11-424d-adb7-4229a5ab333c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68872024-11-14T04:52:04.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bb2337ea-af11-424d-adb7-4229a5ab333c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68882024-11-14T04:52:05.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83e3cae9-c544-45cf-aa45-50e989e3d2d4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68892024-11-14T04:52:05.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83e3cae9-c544-45cf-aa45-50e989e3d2d4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68902024-11-14T04:52:05.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 83e3cae9-c544-45cf-aa45-50e989e3d2d4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
68912024-11-14T04:52:05.260ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 473 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = c0be0754-e00f-4f4f-b6cd-8c7fcc45da4a response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
68922024-11-14T04:52:05.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
68932024-11-14T04:52:05.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
68942024-11-14T04:52:05.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68952024-11-14T04:52:05.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68962024-11-14T04:52:05.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68972024-11-14T04:52:05.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68982024-11-14T04:52:05.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68992024-11-14T04:52:05.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69002024-11-14T04:52:05.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69012024-11-14T04:52:05.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69022024-11-14T04:52:05.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69032024-11-14T04:52:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69042024-11-14T04:52:05.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69052024-11-14T04:52:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
69062024-11-14T04:52:05.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69072024-11-14T04:52:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69082024-11-14T04:52:05.332ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
69092024-11-14T04:52:05.332ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.601714ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
69102024-11-14T04:52:05.342ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69112024-11-14T04:52:05.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69122024-11-14T04:52:05.370ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.193261ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69132024-11-14T04:52:06.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 349784a4-7972-44ea-b14c-920e6b69d089 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69142024-11-14T04:52:06.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 349784a4-7972-44ea-b14c-920e6b69d089 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69152024-11-14T04:52:06.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 349784a4-7972-44ea-b14c-920e6b69d089 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69162024-11-14T04:52:07.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c17e2146-bd54-4df2-9d46-0f2e9b450ca3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69172024-11-14T04:52:07.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c17e2146-bd54-4df2-9d46-0f2e9b450ca3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69182024-11-14T04:52:07.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c17e2146-bd54-4df2-9d46-0f2e9b450ca3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69192024-11-14T04:52:08.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0ee72c7b-1173-4003-9c70-c88d471aaf09 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69202024-11-14T04:52:08.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0ee72c7b-1173-4003-9c70-c88d471aaf09 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69212024-11-14T04:52:08.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0ee72c7b-1173-4003-9c70-c88d471aaf09 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69222024-11-14T04:52:09.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ead9135-0cfd-4d57-9561-1b8fb3a86352 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69232024-11-14T04:52:09.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ead9135-0cfd-4d57-9561-1b8fb3a86352 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69242024-11-14T04:52:09.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9ead9135-0cfd-4d57-9561-1b8fb3a86352 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69252024-11-14T04:52:10.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d01d1191-372e-45aa-aa99-2e51d747c507 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69262024-11-14T04:52:10.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d01d1191-372e-45aa-aa99-2e51d747c507 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69272024-11-14T04:52:10.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d01d1191-372e-45aa-aa99-2e51d747c507 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69282024-11-14T04:52:11.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce840ecd-ea9f-430d-a71f-fe5b15d384ca roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69292024-11-14T04:52:11.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce840ecd-ea9f-430d-a71f-fe5b15d384ca resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69302024-11-14T04:52:11.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce840ecd-ea9f-430d-a71f-fe5b15d384ca response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69312024-11-14T04:52:12.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b1ba1077-4ba2-4877-b110-d41995bfc31c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69322024-11-14T04:52:12.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b1ba1077-4ba2-4877-b110-d41995bfc31c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69332024-11-14T04:52:12.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b1ba1077-4ba2-4877-b110-d41995bfc31c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69342024-11-14T04:52:13.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 79e9504d-281f-46e7-bc7f-a0e0c2ba324d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69352024-11-14T04:52:13.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 79e9504d-281f-46e7-bc7f-a0e0c2ba324d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69362024-11-14T04:52:13.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 79e9504d-281f-46e7-bc7f-a0e0c2ba324d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69372024-11-14T04:52:14.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fbabc7f6-7d70-4b84-ae5c-52d38a05a9c9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69382024-11-14T04:52:14.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fbabc7f6-7d70-4b84-ae5c-52d38a05a9c9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69392024-11-14T04:52:14.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fbabc7f6-7d70-4b84-ae5c-52d38a05a9c9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
69402024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
69412024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
69422024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69432024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69442024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
69452024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
69462024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69472024-11-14T04:52:15.308ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:42:15.308391577 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
69482024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
69492024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
69502024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
69512024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69522024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
69532024-11-14T04:52:15.308ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
69542024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
69552024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.97\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
69562024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69572024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
69582024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
69592024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69602024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
69612024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
69622024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
69632024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
69642024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69652024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
69662024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
69672024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69682024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
69692024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
69702024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69712024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69722024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
69732024-11-14T04:52:15.308ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69742024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
69752024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69762024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
69772024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
69782024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
69792024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69802024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69812024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69822024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
69832024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69842024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
69852024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69862024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
69872024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69882024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
69892024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
69902024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
69912024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
69922024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69932024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69942024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
69952024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69962024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
69972024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
69982024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
69992024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
70002024-11-14T04:52:15.308ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
70012024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
70022024-11-14T04:52:15.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70032024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70042024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70052024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
70062024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70072024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70082024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
70092024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
70102024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70112024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70122024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70132024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70142024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70152024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70162024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70172024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70182024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70192024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70202024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70212024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70222024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70232024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70242024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70252024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70262024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70272024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70282024-11-14T04:52:15.309ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 83520812 } })
70292024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70302024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70312024-11-14T04:52:15.309ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 83557783 } })
70322024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70332024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70342024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70352024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70362024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
70372024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70382024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70392024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.290228ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
70402024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
70412024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.354779ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
70422024-11-14T04:52:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70432024-11-14T04:52:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.368208ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
70442024-11-14T04:52:15.312ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.587344ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70452024-11-14T04:52:15.312ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 87013043 } })
70462024-11-14T04:52:15.313ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
70472024-11-14T04:52:15.313ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:42:15.308391577 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70482024-11-14T04:52:15.313ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.83319ms iteration = 7 status = {"expiration":"2024-11-14T04:42:15.308391577Z","pruned":[]}
70492024-11-14T04:52:15.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70502024-11-14T04:52:15.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70512024-11-14T04:52:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70522024-11-14T04:52:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70532024-11-14T04:52:15.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70542024-11-14T04:52:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70552024-11-14T04:52:15.319ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 93148671 } })
70562024-11-14T04:52:15.319ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
70572024-11-14T04:52:15.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70582024-11-14T04:52:15.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70592024-11-14T04:52:15.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.955999ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
70602024-11-14T04:52:15.367ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70612024-11-14T04:52:15.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70622024-11-14T04:52:15.371ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70632024-11-14T04:52:15.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70642024-11-14T04:52:15.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70652024-11-14T04:52:15.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70662024-11-14T04:52:15.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70672024-11-14T04:52:15.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70682024-11-14T04:52:15.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70692024-11-14T04:52:15.374ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70702024-11-14T04:52:15.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.147395ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
70712024-11-14T04:52:15.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70722024-11-14T04:52:15.376ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70732024-11-14T04:52:15.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70742024-11-14T04:52:15.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
70752024-11-14T04:52:15.377ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
70762024-11-14T04:52:15.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70772024-11-14T04:52:15.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
70782024-11-14T04:52:15.378ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70792024-11-14T04:52:15.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
70802024-11-14T04:52:15.378ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70812024-11-14T04:52:15.378ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70822024-11-14T04:52:15.378ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70832024-11-14T04:52:15.378ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
70842024-11-14T04:52:15.378ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.340857ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
70852024-11-14T04:52:15.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70862024-11-14T04:52:15.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70872024-11-14T04:52:15.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70882024-11-14T04:52:15.379ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70892024-11-14T04:52:15.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.117469ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70902024-11-14T04:52:15.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70912024-11-14T04:52:15.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70922024-11-14T04:52:15.380ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70932024-11-14T04:52:15.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70942024-11-14T04:52:15.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70952024-11-14T04:52:15.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70962024-11-14T04:52:15.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70972024-11-14T04:52:15.382ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70982024-11-14T04:52:15.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70992024-11-14T04:52:15.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71002024-11-14T04:52:15.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71012024-11-14T04:52:15.383ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71022024-11-14T04:52:15.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71032024-11-14T04:52:15.383ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71042024-11-14T04:52:15.384ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71052024-11-14T04:52:15.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71062024-11-14T04:52:15.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71072024-11-14T04:52:15.386ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71082024-11-14T04:52:15.386ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71092024-11-14T04:52:15.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71102024-11-14T04:52:15.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71112024-11-14T04:52:15.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71122024-11-14T04:52:15.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71132024-11-14T04:52:15.392ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71142024-11-14T04:52:15.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71152024-11-14T04:52:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71162024-11-14T04:52:15.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71172024-11-14T04:52:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71182024-11-14T04:52:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71192024-11-14T04:52:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71202024-11-14T04:52:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71212024-11-14T04:52:15.405ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71222024-11-14T04:52:15.405ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71232024-11-14T04:52:15.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71242024-11-14T04:52:15.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71252024-11-14T04:52:15.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71262024-11-14T04:52:15.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71272024-11-14T04:52:15.410ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71282024-11-14T04:52:15.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.944182ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71292024-11-14T04:52:15.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 102.450287ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71302024-11-14T04:52:15.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71312024-11-14T04:52:15.413ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71322024-11-14T04:52:15.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71332024-11-14T04:52:15.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71342024-11-14T04:52:15.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71352024-11-14T04:52:15.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71362024-11-14T04:52:15.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71372024-11-14T04:52:15.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71382024-11-14T04:52:15.425ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71392024-11-14T04:52:15.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71402024-11-14T04:52:15.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71412024-11-14T04:52:15.426ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1314, tv_nsec: 200375096 } })
71422024-11-14T04:52:15.426ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
71432024-11-14T04:52:15.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71442024-11-14T04:52:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71452024-11-14T04:52:15.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71462024-11-14T04:52:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71472024-11-14T04:52:15.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
71482024-11-14T04:52:15.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71492024-11-14T04:52:15.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71502024-11-14T04:52:15.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a4f4a1cf-61de-4de3-be0e-3b993a752152 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
71512024-11-14T04:52:15.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a4f4a1cf-61de-4de3-be0e-3b993a752152 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
71522024-11-14T04:52:15.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a4f4a1cf-61de-4de3-be0e-3b993a752152 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
71532024-11-14T04:52:15.464ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71542024-11-14T04:52:15.467ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
71552024-11-14T04:52:15.467ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71562024-11-14T04:52:15.467ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71572024-11-14T04:52:15.467ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71582024-11-14T04:52:15.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71592024-11-14T04:52:15.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71602024-11-14T04:52:15.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
71612024-11-14T04:52:15.468ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71622024-11-14T04:52:15.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71632024-11-14T04:52:15.472ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 163.451393ms iteration = 4 status = {"nsuccess":5}
71642024-11-14T04:52:15.472ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71652024-11-14T04:52:15.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71662024-11-14T04:52:15.483ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71672024-11-14T04:52:15.483ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
71682024-11-14T04:52:15.483ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 174.432941ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71692024-11-14T04:52:15.483ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
71702024-11-14T04:52:15.483ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 174.786472ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
71712024-11-14T04:52:15.487ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71722024-11-14T04:52:15.487ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71732024-11-14T04:52:15.487ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71742024-11-14T04:52:15.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71752024-11-14T04:52:15.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71762024-11-14T04:52:15.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71772024-11-14T04:52:15.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71782024-11-14T04:52:15.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71792024-11-14T04:52:15.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71802024-11-14T04:52:15.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71812024-11-14T04:52:15.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71822024-11-14T04:52:15.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71832024-11-14T04:52:15.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71842024-11-14T04:52:15.497ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71852024-11-14T04:52:15.501ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71862024-11-14T04:52:15.501ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71872024-11-14T04:52:15.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71882024-11-14T04:52:15.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
71892024-11-14T04:52:15.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71902024-11-14T04:52:15.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71912024-11-14T04:52:15.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71922024-11-14T04:52:15.507ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 198.899109ms iteration = 13 status = 0
71932024-11-14T04:52:15.507ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 199.012524ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
71942024-11-14T04:52:15.509ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952024-11-14T04:52:15.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71962024-11-14T04:52:15.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71972024-11-14T04:52:15.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
71982024-11-14T04:52:15.514ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71992024-11-14T04:52:15.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72002024-11-14T04:52:15.515ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72012024-11-14T04:52:15.515ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72022024-11-14T04:52:15.516ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c905b3f7-046f-4aaf-aa7d-8fbe7cb39986", "content-length": "26", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
72032024-11-14T04:52:15.516ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72042024-11-14T04:52:15.523ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72052024-11-14T04:52:15.524ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72062024-11-14T04:52:15.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72072024-11-14T04:52:15.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72082024-11-14T04:52:15.547ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72092024-11-14T04:52:15.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72102024-11-14T04:52:15.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72112024-11-14T04:52:15.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72122024-11-14T04:52:15.553ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
72132024-11-14T04:52:15.553ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
72142024-11-14T04:52:15.553ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72152024-11-14T04:52:15.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72162024-11-14T04:52:15.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72172024-11-14T04:52:15.556ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 247.95788ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72182024-11-14T04:52:15.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72192024-11-14T04:52:15.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72202024-11-14T04:52:15.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72212024-11-14T04:52:15.565ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
72222024-11-14T04:52:15.565ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
72232024-11-14T04:52:15.565ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
72242024-11-14T04:52:15.565ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 256.420365ms iteration = 7 status = {"generation":1}
72252024-11-14T04:52:15.569ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72262024-11-14T04:52:15.569ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72272024-11-14T04:52:15.569ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 261.322507ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72282024-11-14T04:52:15.570ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72292024-11-14T04:52:15.570ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72302024-11-14T04:52:15.571ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86697329-1660-466b-8a2c-d60464884f76", "content-length": "26", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
72312024-11-14T04:52:15.571ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72322024-11-14T04:52:15.573ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72332024-11-14T04:52:15.588ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
72342024-11-14T04:52:15.588ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
72352024-11-14T04:52:15.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72362024-11-14T04:52:15.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72372024-11-14T04:52:15.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72382024-11-14T04:52:15.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72392024-11-14T04:52:15.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72402024-11-14T04:52:15.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72412024-11-14T04:52:15.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72422024-11-14T04:52:15.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72432024-11-14T04:52:15.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72442024-11-14T04:52:15.596ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
72452024-11-14T04:52:15.596ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72462024-11-14T04:52:15.596ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
72472024-11-14T04:52:15.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 287.9991ms iteration = 7 status = {"generation":2}
72482024-11-14T04:52:15.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72492024-11-14T04:52:15.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72502024-11-14T04:52:15.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72512024-11-14T04:52:15.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72522024-11-14T04:52:15.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72532024-11-14T04:52:15.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72542024-11-14T04:52:15.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72552024-11-14T04:52:15.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72562024-11-14T04:52:15.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72572024-11-14T04:52:15.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72582024-11-14T04:52:15.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72592024-11-14T04:52:15.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72602024-11-14T04:52:15.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72612024-11-14T04:52:15.618ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 309.74014ms iteration = 15 status = {"physical_disks_added":0}
72622024-11-14T04:52:15.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
72632024-11-14T04:52:15.622ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72642024-11-14T04:52:15.622ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abf5f7d4-0b06-4dbc-9166-c3bf00b714e3", "content-length": "26", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
72652024-11-14T04:52:15.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72662024-11-14T04:52:15.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
72672024-11-14T04:52:15.629ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72682024-11-14T04:52:15.629ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 321.117799ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72692024-11-14T04:52:15.643ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
72702024-11-14T04:52:15.643ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f306d749-26e5-49a0-a2d5-14cdc0a73787", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72712024-11-14T04:52:15.643ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72722024-11-14T04:52:15.644ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5e1e4087-9536-4273-bc92-759af9871de1", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72732024-11-14T04:52:15.644ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72742024-11-14T04:52:15.646ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
72752024-11-14T04:52:15.646ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 337.994698ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72762024-11-14T04:52:15.651ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
72772024-11-14T04:52:15.651ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 342.938081ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
72782024-11-14T04:52:15.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72792024-11-14T04:52:15.705ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 397.197152ms iteration = 13 status = {}
72802024-11-14T04:52:15.721ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72812024-11-14T04:52:15.721ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72822024-11-14T04:52:15.723ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dddce36-a781-48e1-8ee6-0d1f37a89018", "content-length": "372", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
72832024-11-14T04:52:15.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72842024-11-14T04:52:15.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72852024-11-14T04:52:15.741ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72862024-11-14T04:52:15.741ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1126dadf-3f2b-4f25-b3a0-db34b3c0e259", "content-length": "1", "date": "Thu, 14 Nov 2024 04:52:14 GMT"} })
72872024-11-14T04:52:15.743ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72882024-11-14T04:52:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72892024-11-14T04:52:15.745ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 437.298813ms iteration = 13 status = null
72902024-11-14T04:52:15.766ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72912024-11-14T04:52:15.766ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72922024-11-14T04:52:15.766ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0aaaaea4-70fa-4e66-bb34-b54f892ff17d", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
72932024-11-14T04:52:15.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72942024-11-14T04:52:15.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72952024-11-14T04:52:15.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72962024-11-14T04:52:15.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72972024-11-14T04:52:15.789ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72982024-11-14T04:52:15.790ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a3f20612-96a0-46a4-8372-9fd40d26d8ac", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
72992024-11-14T04:52:15.790ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73002024-11-14T04:52:15.792ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "41232b12-7533-41a2-a8c8-a770487821da", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73012024-11-14T04:52:15.792ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73022024-11-14T04:52:15.793ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7b802e05-7315-4010-a158-3c2168335d9e", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73032024-11-14T04:52:15.793ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73042024-11-14T04:52:15.795ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73052024-11-14T04:52:15.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 487.003253ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
73062024-11-14T04:52:15.810ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73072024-11-14T04:52:15.811ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca444394-7651-467e-adc3-13f305f7c3c1", "content-length": "691", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
73082024-11-14T04:52:15.811ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
73092024-11-14T04:52:15.811ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73102024-11-14T04:52:15.811ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73112024-11-14T04:52:15.812ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 503.53024ms iteration = 13 status = {}
73122024-11-14T04:52:15.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73132024-11-14T04:52:15.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73142024-11-14T04:52:15.817ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73152024-11-14T04:52:15.817ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73162024-11-14T04:52:15.817ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9913e934-d8f1-40e2-9407-334f6b05204c", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
73172024-11-14T04:52:15.818ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 510.125331ms iteration = 13 status = {}
73182024-11-14T04:52:15.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73192024-11-14T04:52:15.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73202024-11-14T04:52:15.885ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
73212024-11-14T04:52:15.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73222024-11-14T04:52:15.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73232024-11-14T04:52:15.895ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73242024-11-14T04:52:15.895ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "21722181-c5c4-49ed-a437-919b13ec8da1", "content-length": "134", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
73252024-11-14T04:52:15.895ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73262024-11-14T04:52:15.895ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
73272024-11-14T04:52:15.895ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73282024-11-14T04:52:15.895ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73292024-11-14T04:52:15.895ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73302024-11-14T04:52:15.895ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73312024-11-14T04:52:15.895ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73322024-11-14T04:52:15.895ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73332024-11-14T04:52:15.896ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73342024-11-14T04:52:15.896ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73352024-11-14T04:52:15.896ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
73362024-11-14T04:52:15.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73372024-11-14T04:52:15.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73382024-11-14T04:52:15.898ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73392024-11-14T04:52:15.898ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c9b7ff4-42a4-49e9-b351-4be0b81f7283", "content-length": "2", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
73402024-11-14T04:52:15.898ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73412024-11-14T04:52:15.898ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bde2dcd3-9098-4611-9e85-bcb27e30e7eb", "content-length": "51", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
73422024-11-14T04:52:15.898ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
73432024-11-14T04:52:15.898ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73442024-11-14T04:52:15.920ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
73452024-11-14T04:52:15.920ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
73462024-11-14T04:52:15.950ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
73472024-11-14T04:52:15.950ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:47076
73482024-11-14T04:52:15.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47076 req_id = 0081fe43-3632-4d68-b260-0d37bfd6b49c roles = RoleSet { roles: {} } uri = /metrics/producers
73492024-11-14T04:52:15.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47076 req_id = 0081fe43-3632-4d68-b260-0d37bfd6b49c resource = Database result = Ok(()) uri = /metrics/producers
73502024-11-14T04:52:15.999ZINFOnexus: assigned collector to new producer collector_id = 459b411b-9021-43ae-8875-254e55794157 file = nexus/src/app/oximeter.rs:76 producer_id = 79994e02-6747-4071-83af-7872b31640fb
73512024-11-14T04:52:15.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49031 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47076 req_id = 0081fe43-3632-4d68-b260-0d37bfd6b49c response_code = 201 uri = /metrics/producers
73522024-11-14T04:52:15.999ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0081fe43-3632-4d68-b260-0d37bfd6b49c", "content-length": "41", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
73532024-11-14T04:52:16.000ZDEBGnexus (producer-registration-task): registered with nexus successfully
73542024-11-14T04:52:16.000ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
73552024-11-14T04:52:16.001ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "15f9328e-9c30-4b72-b6e0-4d8d648e9ec3", "date": "Thu, 14 Nov 2024 04:52:15 GMT"} })
73562024-11-14T04:52:16.001ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
73572024-11-14T04:52:16.001ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73582024-11-14T04:52:16.006ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf884ebd-e774-4f94-82b7-5271f36683a3", "content-length": "682", "date": "Thu, 14 Nov 2024 04:52:16 GMT"} })
73592024-11-14T04:52:16.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73602024-11-14T04:52:16.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73612024-11-14T04:52:16.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73622024-11-14T04:52:16.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73632024-11-14T04:52:16.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73642024-11-14T04:52:16.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73652024-11-14T04:52:16.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73662024-11-14T04:52:16.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73672024-11-14T04:52:16.024ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 715.389006ms iteration = 13 status = {}
73682024-11-14T04:52:16.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d98afdc6-e84a-41e6-a00f-9667647c7e22 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73692024-11-14T04:52:16.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d98afdc6-e84a-41e6-a00f-9667647c7e22 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73702024-11-14T04:52:16.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d98afdc6-e84a-41e6-a00f-9667647c7e22 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73712024-11-14T04:52:16.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 66b4f7c8-06c6-4297-8fa6-fb1fc43c8fb4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
73722024-11-14T04:52:16.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 66b4f7c8-06c6-4297-8fa6-fb1fc43c8fb4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
73732024-11-14T04:52:16.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 66b4f7c8-06c6-4297-8fa6-fb1fc43c8fb4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
73742024-11-14T04:52:17.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce80fe98-7181-4a9a-9ad9-880adbdfaf0b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73752024-11-14T04:52:17.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce80fe98-7181-4a9a-9ad9-880adbdfaf0b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73762024-11-14T04:52:17.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce80fe98-7181-4a9a-9ad9-880adbdfaf0b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73772024-11-14T04:52:18.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0f3be3e1-f053-435d-9ca7-e41ff5fea793 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73782024-11-14T04:52:18.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0f3be3e1-f053-435d-9ca7-e41ff5fea793 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73792024-11-14T04:52:18.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0f3be3e1-f053-435d-9ca7-e41ff5fea793 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73802024-11-14T04:52:19.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 701e5428-e259-40aa-90cf-a40cb6fbd731 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73812024-11-14T04:52:19.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 701e5428-e259-40aa-90cf-a40cb6fbd731 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73822024-11-14T04:52:19.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 701e5428-e259-40aa-90cf-a40cb6fbd731 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73832024-11-14T04:52:20.260ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 498f666f-d5e3-4f72-b68e-082a1485e0e7 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
73842024-11-14T04:52:20.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 587836e8-2e50-4b48-9243-08f4d6e51bbd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73852024-11-14T04:52:20.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 587836e8-2e50-4b48-9243-08f4d6e51bbd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73862024-11-14T04:52:20.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 587836e8-2e50-4b48-9243-08f4d6e51bbd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73872024-11-14T04:52:21.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd185ba1-240f-4941-bc92-b2bb953c1215 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73882024-11-14T04:52:21.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd185ba1-240f-4941-bc92-b2bb953c1215 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73892024-11-14T04:52:21.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd185ba1-240f-4941-bc92-b2bb953c1215 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73902024-11-14T04:52:22.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 183583af-fae1-48d9-987c-422593c10c7f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73912024-11-14T04:52:22.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 183583af-fae1-48d9-987c-422593c10c7f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73922024-11-14T04:52:22.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 183583af-fae1-48d9-987c-422593c10c7f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73932024-11-14T04:52:23.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58f78b37-c031-4d3e-9249-76a936a816df roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73942024-11-14T04:52:23.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58f78b37-c031-4d3e-9249-76a936a816df resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73952024-11-14T04:52:23.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 58f78b37-c031-4d3e-9249-76a936a816df response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73962024-11-14T04:52:24.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b9284ce4-7e8e-4d16-82b7-3d5446e3439d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73972024-11-14T04:52:24.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b9284ce4-7e8e-4d16-82b7-3d5446e3439d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73982024-11-14T04:52:24.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b9284ce4-7e8e-4d16-82b7-3d5446e3439d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
73992024-11-14T04:52:25.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
74002024-11-14T04:52:25.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
74012024-11-14T04:52:25.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74022024-11-14T04:52:25.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74032024-11-14T04:52:25.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74042024-11-14T04:52:25.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74052024-11-14T04:52:25.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74062024-11-14T04:52:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74072024-11-14T04:52:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74082024-11-14T04:52:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74092024-11-14T04:52:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74102024-11-14T04:52:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74112024-11-14T04:52:25.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74122024-11-14T04:52:25.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
74132024-11-14T04:52:25.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74142024-11-14T04:52:25.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74152024-11-14T04:52:25.334ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
74162024-11-14T04:52:25.334ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.24755ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
74172024-11-14T04:52:25.340ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74182024-11-14T04:52:25.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74192024-11-14T04:52:25.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.698155ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74202024-11-14T04:52:25.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7f11eb6-5eac-4a2f-a15c-fd8cd0d54eff roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74212024-11-14T04:52:25.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7f11eb6-5eac-4a2f-a15c-fd8cd0d54eff resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74222024-11-14T04:52:25.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7f11eb6-5eac-4a2f-a15c-fd8cd0d54eff response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74232024-11-14T04:52:26.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 964e25a3-af51-48ab-ac10-a6fcf902dd6c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74242024-11-14T04:52:26.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 964e25a3-af51-48ab-ac10-a6fcf902dd6c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74252024-11-14T04:52:26.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 964e25a3-af51-48ab-ac10-a6fcf902dd6c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74262024-11-14T04:52:27.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e36abdd9-44de-4bbe-be9f-3389f120cec3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74272024-11-14T04:52:27.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e36abdd9-44de-4bbe-be9f-3389f120cec3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74282024-11-14T04:52:27.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e36abdd9-44de-4bbe-be9f-3389f120cec3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74292024-11-14T04:52:28.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 78a43c19-e016-4871-96a7-624ca127d76c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74302024-11-14T04:52:28.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 78a43c19-e016-4871-96a7-624ca127d76c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74312024-11-14T04:52:28.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 78a43c19-e016-4871-96a7-624ca127d76c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74322024-11-14T04:52:29.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 06ee8a46-6ef4-476b-bb43-95b4e596b345 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74332024-11-14T04:52:29.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 06ee8a46-6ef4-476b-bb43-95b4e596b345 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74342024-11-14T04:52:29.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 06ee8a46-6ef4-476b-bb43-95b4e596b345 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74352024-11-14T04:52:30.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 663ce2b4-f953-4cc1-b089-a63192abcdbd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74362024-11-14T04:52:30.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 663ce2b4-f953-4cc1-b089-a63192abcdbd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74372024-11-14T04:52:30.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 663ce2b4-f953-4cc1-b089-a63192abcdbd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74382024-11-14T04:52:31.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a4c9aa4-0ef4-444a-8b35-87499bf69fc4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74392024-11-14T04:52:31.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a4c9aa4-0ef4-444a-8b35-87499bf69fc4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74402024-11-14T04:52:31.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a4c9aa4-0ef4-444a-8b35-87499bf69fc4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74412024-11-14T04:52:32.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afb1ea2d-e913-4d3e-8f87-3c4bc25f5862 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74422024-11-14T04:52:32.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afb1ea2d-e913-4d3e-8f87-3c4bc25f5862 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74432024-11-14T04:52:32.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = afb1ea2d-e913-4d3e-8f87-3c4bc25f5862 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74442024-11-14T04:52:33.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 73d9c2f5-b913-414d-8d6b-006563c2aee3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74452024-11-14T04:52:33.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 73d9c2f5-b913-414d-8d6b-006563c2aee3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74462024-11-14T04:52:33.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 73d9c2f5-b913-414d-8d6b-006563c2aee3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74472024-11-14T04:52:34.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 57cea7b1-1742-4b30-a986-75d2f98d1401 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74482024-11-14T04:52:34.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 57cea7b1-1742-4b30-a986-75d2f98d1401 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74492024-11-14T04:52:34.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 57cea7b1-1742-4b30-a986-75d2f98d1401 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74502024-11-14T04:52:35.260ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 4fafa119-9e0d-419a-a62d-6f61894d817f response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
74512024-11-14T04:52:35.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
74522024-11-14T04:52:35.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
74532024-11-14T04:52:35.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74542024-11-14T04:52:35.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74552024-11-14T04:52:35.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74562024-11-14T04:52:35.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74572024-11-14T04:52:35.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74582024-11-14T04:52:35.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74592024-11-14T04:52:35.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74602024-11-14T04:52:35.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74612024-11-14T04:52:35.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74622024-11-14T04:52:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74632024-11-14T04:52:35.336ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74642024-11-14T04:52:35.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74652024-11-14T04:52:35.337ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.745851ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74662024-11-14T04:52:35.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74672024-11-14T04:52:35.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
74682024-11-14T04:52:35.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74692024-11-14T04:52:35.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74702024-11-14T04:52:35.356ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
74712024-11-14T04:52:35.356ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.245827ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
74722024-11-14T04:52:35.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a5c4806-d85e-4f01-bbf1-41c451c524a4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74732024-11-14T04:52:35.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a5c4806-d85e-4f01-bbf1-41c451c524a4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74742024-11-14T04:52:35.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a5c4806-d85e-4f01-bbf1-41c451c524a4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74752024-11-14T04:52:36.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6412ec2-56f9-4cc4-8743-e6d83b98f989 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74762024-11-14T04:52:36.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6412ec2-56f9-4cc4-8743-e6d83b98f989 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74772024-11-14T04:52:36.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6412ec2-56f9-4cc4-8743-e6d83b98f989 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74782024-11-14T04:52:37.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9807b67f-dd1d-4599-a969-2967766536d3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74792024-11-14T04:52:37.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9807b67f-dd1d-4599-a969-2967766536d3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74802024-11-14T04:52:37.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9807b67f-dd1d-4599-a969-2967766536d3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74812024-11-14T04:52:38.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 390a5088-a6a0-41d9-baf3-dcc958d5e864 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74822024-11-14T04:52:38.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 390a5088-a6a0-41d9-baf3-dcc958d5e864 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74832024-11-14T04:52:38.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 390a5088-a6a0-41d9-baf3-dcc958d5e864 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74842024-11-14T04:52:39.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f60819fb-1394-42b7-a9ec-5ab9639b88e9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74852024-11-14T04:52:39.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f60819fb-1394-42b7-a9ec-5ab9639b88e9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74862024-11-14T04:52:39.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f60819fb-1394-42b7-a9ec-5ab9639b88e9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74872024-11-14T04:52:41.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5dd9ae2-ad2c-4846-a74c-66ec37838262 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74882024-11-14T04:52:41.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5dd9ae2-ad2c-4846-a74c-66ec37838262 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74892024-11-14T04:52:41.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5dd9ae2-ad2c-4846-a74c-66ec37838262 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74902024-11-14T04:52:42.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 09cd381b-e275-43e7-96e4-7fe688771d00 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74912024-11-14T04:52:42.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 09cd381b-e275-43e7-96e4-7fe688771d00 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74922024-11-14T04:52:42.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 09cd381b-e275-43e7-96e4-7fe688771d00 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74932024-11-14T04:52:43.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b4eb2013-4ac7-4b59-91c6-0eed34b682eb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74942024-11-14T04:52:43.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b4eb2013-4ac7-4b59-91c6-0eed34b682eb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74952024-11-14T04:52:43.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b4eb2013-4ac7-4b59-91c6-0eed34b682eb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74962024-11-14T04:52:44.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e393d9e2-12e7-4690-b353-503109890b0a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74972024-11-14T04:52:44.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e393d9e2-12e7-4690-b353-503109890b0a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74982024-11-14T04:52:44.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e393d9e2-12e7-4690-b353-503109890b0a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
74992024-11-14T04:52:45.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1677abc9-894f-428a-8ffb-655f460fd9de roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
75002024-11-14T04:52:45.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1677abc9-894f-428a-8ffb-655f460fd9de resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
75012024-11-14T04:52:45.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1677abc9-894f-428a-8ffb-655f460fd9de response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
75022024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
75032024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
75042024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75052024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
75062024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75072024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
75082024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75092024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
75102024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
75112024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75122024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
75132024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75142024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75152024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
75162024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75172024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
75182024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75192024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
75202024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
75212024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75222024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75232024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
75242024-11-14T04:52:45.308ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75252024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75262024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
75272024-11-14T04:52:45.309ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75282024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75292024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
75302024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75312024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
75322024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75332024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
75342024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75352024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
75362024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75372024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75382024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75392024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75402024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75412024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75422024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75432024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75442024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75452024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75462024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75472024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75482024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75492024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75502024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75512024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75522024-11-14T04:52:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75532024-11-14T04:52:45.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75542024-11-14T04:52:45.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75552024-11-14T04:52:45.312ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.055288ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75562024-11-14T04:52:45.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572024-11-14T04:52:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75582024-11-14T04:52:45.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75592024-11-14T04:52:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75602024-11-14T04:52:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75612024-11-14T04:52:45.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75622024-11-14T04:52:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75632024-11-14T04:52:45.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75642024-11-14T04:52:45.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75652024-11-14T04:52:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75662024-11-14T04:52:45.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75672024-11-14T04:52:45.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75682024-11-14T04:52:45.318ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 93146285 } })
75692024-11-14T04:52:45.319ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
75702024-11-14T04:52:45.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712024-11-14T04:52:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75722024-11-14T04:52:45.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75732024-11-14T04:52:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75742024-11-14T04:52:45.321ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75752024-11-14T04:52:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75762024-11-14T04:52:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75772024-11-14T04:52:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75782024-11-14T04:52:45.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75792024-11-14T04:52:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75802024-11-14T04:52:45.323ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 98163331 } })
75812024-11-14T04:52:45.324ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
75822024-11-14T04:52:45.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75832024-11-14T04:52:45.325ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75842024-11-14T04:52:45.325ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75852024-11-14T04:52:45.325ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75862024-11-14T04:52:45.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75872024-11-14T04:52:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75882024-11-14T04:52:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75892024-11-14T04:52:45.326ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1344, tv_nsec: 101054654 } })
75902024-11-14T04:52:45.327ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
75912024-11-14T04:52:45.327ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75922024-11-14T04:52:45.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75932024-11-14T04:52:45.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75942024-11-14T04:52:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75952024-11-14T04:52:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75962024-11-14T04:52:45.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75972024-11-14T04:52:45.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75982024-11-14T04:52:45.331ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75992024-11-14T04:52:45.331ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76002024-11-14T04:52:45.331ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76012024-11-14T04:52:45.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76022024-11-14T04:52:45.331ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76032024-11-14T04:52:45.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
76042024-11-14T04:52:45.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76052024-11-14T04:52:45.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76062024-11-14T04:52:45.360ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.585304ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
76072024-11-14T04:52:45.368ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76082024-11-14T04:52:45.369ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76092024-11-14T04:52:45.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76102024-11-14T04:52:45.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76112024-11-14T04:52:45.369ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76122024-11-14T04:52:45.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76132024-11-14T04:52:45.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76142024-11-14T04:52:45.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76152024-11-14T04:52:45.375ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
76162024-11-14T04:52:45.375ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.111635ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
76172024-11-14T04:52:45.379ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76182024-11-14T04:52:45.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.11447ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
76192024-11-14T04:52:45.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76202024-11-14T04:52:45.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76212024-11-14T04:52:45.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76222024-11-14T04:52:45.382ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76232024-11-14T04:52:45.382ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.411856ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76242024-11-14T04:52:45.382ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76252024-11-14T04:52:45.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76262024-11-14T04:52:45.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76272024-11-14T04:52:45.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
76282024-11-14T04:52:45.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76292024-11-14T04:52:45.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76302024-11-14T04:52:45.392ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.173789ms iteration = 14 status = 0
76312024-11-14T04:52:45.411ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
76322024-11-14T04:52:45.411ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76332024-11-14T04:52:45.411ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c29b3e20-e931-40d2-8a0c-0fd569c16a36", "content-length": "26", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
76342024-11-14T04:52:45.411ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76352024-11-14T04:52:45.414ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76362024-11-14T04:52:45.415ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76372024-11-14T04:52:45.417ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76382024-11-14T04:52:45.417ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76392024-11-14T04:52:45.418ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.061018ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76402024-11-14T04:52:45.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76412024-11-14T04:52:45.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76422024-11-14T04:52:45.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76432024-11-14T04:52:45.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.537835ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76442024-11-14T04:52:45.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 118.709277ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76452024-11-14T04:52:45.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.855182ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76462024-11-14T04:52:45.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
76472024-11-14T04:52:45.439ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76482024-11-14T04:52:45.439ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6a6b6c2-eef7-4a88-bc97-8c602536283b", "content-length": "26", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
76492024-11-14T04:52:45.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76502024-11-14T04:52:45.441ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76512024-11-14T04:52:45.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 133.703762ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76522024-11-14T04:52:45.472ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
76532024-11-14T04:52:45.472ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76542024-11-14T04:52:45.472ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91720849-6647-4e24-b53c-6550997e7a32", "content-length": "26", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
76552024-11-14T04:52:45.472ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76562024-11-14T04:52:45.475ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
76572024-11-14T04:52:45.482ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76582024-11-14T04:52:45.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76592024-11-14T04:52:45.533ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76602024-11-14T04:52:45.533ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a5b9e30-01cf-4e41-91ee-cbc2e0c270c6", "content-length": "1", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
76612024-11-14T04:52:45.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76622024-11-14T04:52:45.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76632024-11-14T04:52:45.535ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76642024-11-14T04:52:45.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76652024-11-14T04:52:45.549ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.104503ms iteration = 16 status = {"physical_disks_added":0}
76662024-11-14T04:52:45.549ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 240.623798ms iteration = 14 status = {}
76672024-11-14T04:52:45.560ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76682024-11-14T04:52:45.560ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76692024-11-14T04:52:45.561ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd88009-0216-4610-83c1-16160c0dfaa7", "content-length": "372", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
76702024-11-14T04:52:45.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76712024-11-14T04:52:45.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76722024-11-14T04:52:45.562ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 253.967315ms iteration = 14 status = null
76732024-11-14T04:52:45.569ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742024-11-14T04:52:45.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76752024-11-14T04:52:45.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76762024-11-14T04:52:45.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76772024-11-14T04:52:45.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76782024-11-14T04:52:45.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76792024-11-14T04:52:45.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76802024-11-14T04:52:45.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76812024-11-14T04:52:45.614ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
76822024-11-14T04:52:45.614ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76832024-11-14T04:52:45.614ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4440f158-4c7f-48cd-bde9-20c5d794a963", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
76842024-11-14T04:52:45.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76852024-11-14T04:52:45.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76862024-11-14T04:52:45.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76872024-11-14T04:52:45.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76882024-11-14T04:52:45.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76892024-11-14T04:52:45.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76902024-11-14T04:52:45.624ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76912024-11-14T04:52:45.624ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76922024-11-14T04:52:45.624ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0d577dc9-205a-4dcc-b749-8dffe38eda2c", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
76932024-11-14T04:52:45.626ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.397802ms iteration = 14 status = {}
76942024-11-14T04:52:45.646ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76952024-11-14T04:52:45.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76962024-11-14T04:52:45.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76972024-11-14T04:52:45.670ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
76982024-11-14T04:52:45.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76992024-11-14T04:52:45.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77002024-11-14T04:52:45.679ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77012024-11-14T04:52:45.679ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "297804dc-4176-4380-b36a-3b2d494d788c", "content-length": "134", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
77022024-11-14T04:52:45.679ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77032024-11-14T04:52:45.679ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
77042024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77052024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77062024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77072024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77082024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77092024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77102024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77112024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77122024-11-14T04:52:45.680ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
77132024-11-14T04:52:45.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77142024-11-14T04:52:45.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77152024-11-14T04:52:45.682ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77162024-11-14T04:52:45.682ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "34a369ee-0e38-4857-bf9f-fb81bf0f5261", "content-length": "2", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
77172024-11-14T04:52:45.682ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77182024-11-14T04:52:45.682ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac962818-a685-48e5-a9f3-16a204065d76", "content-length": "51", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
77192024-11-14T04:52:45.682ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
77202024-11-14T04:52:45.682ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77212024-11-14T04:52:45.744ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d11a461-622b-435a-8e85-19389b66859f", "content-length": "691", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
77222024-11-14T04:52:45.744ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
77232024-11-14T04:52:45.744ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
77242024-11-14T04:52:45.744ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
77252024-11-14T04:52:45.746ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 437.229982ms iteration = 14 status = {}
77262024-11-14T04:52:45.933ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e3a1d7aa-ff7b-4c16-b21d-1b29f0e91410", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
77272024-11-14T04:52:45.933ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
77282024-11-14T04:52:45.933ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77292024-11-14T04:52:45.933ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "64b75bcf-baea-496d-9f2b-34ed59bb49e2", "content-length": "682", "date": "Thu, 14 Nov 2024 04:52:45 GMT"} })
77302024-11-14T04:52:45.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77312024-11-14T04:52:45.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77322024-11-14T04:52:45.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77332024-11-14T04:52:45.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77342024-11-14T04:52:45.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77352024-11-14T04:52:45.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77362024-11-14T04:52:45.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77372024-11-14T04:52:45.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77382024-11-14T04:52:45.949ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 640.837627ms iteration = 14 status = {}
77392024-11-14T04:52:46.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cb67c30-c963-481f-94e2-f8a1adf53a20 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77402024-11-14T04:52:46.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cb67c30-c963-481f-94e2-f8a1adf53a20 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77412024-11-14T04:52:46.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cb67c30-c963-481f-94e2-f8a1adf53a20 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77422024-11-14T04:52:46.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 97be7afb-69c3-4b81-be59-c5f5cd4dde65 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
77432024-11-14T04:52:46.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 97be7afb-69c3-4b81-be59-c5f5cd4dde65 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
77442024-11-14T04:52:46.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 97be7afb-69c3-4b81-be59-c5f5cd4dde65 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
77452024-11-14T04:52:47.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c31c008-b81a-429a-bb08-b3d24ff3cef0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77462024-11-14T04:52:47.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c31c008-b81a-429a-bb08-b3d24ff3cef0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77472024-11-14T04:52:47.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c31c008-b81a-429a-bb08-b3d24ff3cef0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77482024-11-14T04:52:48.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce9104a5-a77f-4990-aefc-a7ec60532d87 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77492024-11-14T04:52:48.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce9104a5-a77f-4990-aefc-a7ec60532d87 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77502024-11-14T04:52:48.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ce9104a5-a77f-4990-aefc-a7ec60532d87 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77512024-11-14T04:52:49.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32e72fdd-7382-47e2-a642-3acb96211c65 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77522024-11-14T04:52:49.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32e72fdd-7382-47e2-a642-3acb96211c65 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77532024-11-14T04:52:49.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32e72fdd-7382-47e2-a642-3acb96211c65 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77542024-11-14T04:52:50.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4482c476-27a2-43c5-8948-2b08c9911f38 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77552024-11-14T04:52:50.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4482c476-27a2-43c5-8948-2b08c9911f38 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77562024-11-14T04:52:50.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4482c476-27a2-43c5-8948-2b08c9911f38 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77572024-11-14T04:52:50.258ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 123ec995-ef55-4a1e-a78c-2843671a46e4 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
77582024-11-14T04:52:51.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3414f1f1-6c5c-41f7-be81-d7eed5a16264 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77592024-11-14T04:52:51.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3414f1f1-6c5c-41f7-be81-d7eed5a16264 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77602024-11-14T04:52:51.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3414f1f1-6c5c-41f7-be81-d7eed5a16264 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77612024-11-14T04:52:52.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 492f60fa-4a55-4d4b-9863-0819bac9dac3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77622024-11-14T04:52:52.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 492f60fa-4a55-4d4b-9863-0819bac9dac3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77632024-11-14T04:52:52.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 492f60fa-4a55-4d4b-9863-0819bac9dac3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77642024-11-14T04:52:53.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 179c07b9-4925-4b8a-bd7c-82a9f917b583 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77652024-11-14T04:52:53.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 179c07b9-4925-4b8a-bd7c-82a9f917b583 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77662024-11-14T04:52:53.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 179c07b9-4925-4b8a-bd7c-82a9f917b583 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77672024-11-14T04:52:54.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d2e0c40-f480-470c-9489-e32767d63133 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77682024-11-14T04:52:54.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d2e0c40-f480-470c-9489-e32767d63133 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77692024-11-14T04:52:54.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3d2e0c40-f480-470c-9489-e32767d63133 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77702024-11-14T04:52:55.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
77712024-11-14T04:52:55.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77722024-11-14T04:52:55.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
77732024-11-14T04:52:55.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77742024-11-14T04:52:55.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77752024-11-14T04:52:55.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77762024-11-14T04:52:55.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77772024-11-14T04:52:55.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77782024-11-14T04:52:55.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77792024-11-14T04:52:55.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.666556ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77802024-11-14T04:52:55.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77812024-11-14T04:52:55.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77822024-11-14T04:52:55.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77832024-11-14T04:52:55.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77842024-11-14T04:52:55.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77852024-11-14T04:52:55.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77862024-11-14T04:52:55.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
77872024-11-14T04:52:55.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77882024-11-14T04:52:55.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77892024-11-14T04:52:55.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b71e24ab-b215-4926-83d9-e7bccc2aa2cd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77902024-11-14T04:52:55.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b71e24ab-b215-4926-83d9-e7bccc2aa2cd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77912024-11-14T04:52:55.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b71e24ab-b215-4926-83d9-e7bccc2aa2cd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77922024-11-14T04:52:55.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
77932024-11-14T04:52:55.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.77304ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
77942024-11-14T04:52:56.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9e5ae6b4-edd6-4797-a34d-a65eb325ddb2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77952024-11-14T04:52:56.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9e5ae6b4-edd6-4797-a34d-a65eb325ddb2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77962024-11-14T04:52:56.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9e5ae6b4-edd6-4797-a34d-a65eb325ddb2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77972024-11-14T04:52:57.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b90d7a27-1614-4b07-8eb5-d95e41424ef2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77982024-11-14T04:52:57.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b90d7a27-1614-4b07-8eb5-d95e41424ef2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
77992024-11-14T04:52:57.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b90d7a27-1614-4b07-8eb5-d95e41424ef2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78002024-11-14T04:52:58.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6de850d-7fe2-4e47-8be8-df5bcdd5628b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78012024-11-14T04:52:58.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6de850d-7fe2-4e47-8be8-df5bcdd5628b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78022024-11-14T04:52:58.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6de850d-7fe2-4e47-8be8-df5bcdd5628b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78032024-11-14T04:52:59.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee03a53a-fb8e-4c14-a4a4-b64a406f3f54 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78042024-11-14T04:52:59.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee03a53a-fb8e-4c14-a4a4-b64a406f3f54 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78052024-11-14T04:52:59.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee03a53a-fb8e-4c14-a4a4-b64a406f3f54 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78062024-11-14T04:53:00.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0a876aea-f0da-49db-9a68-288f5cb44c72 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78072024-11-14T04:53:00.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0a876aea-f0da-49db-9a68-288f5cb44c72 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78082024-11-14T04:53:00.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0a876aea-f0da-49db-9a68-288f5cb44c72 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78092024-11-14T04:53:01.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51f94cae-7032-48e7-8a8b-f12df5977135 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78102024-11-14T04:53:01.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51f94cae-7032-48e7-8a8b-f12df5977135 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78112024-11-14T04:53:01.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51f94cae-7032-48e7-8a8b-f12df5977135 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78122024-11-14T04:53:02.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6872701d-6662-4b27-b717-49a2a790322f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78132024-11-14T04:53:02.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6872701d-6662-4b27-b717-49a2a790322f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78142024-11-14T04:53:02.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6872701d-6662-4b27-b717-49a2a790322f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78152024-11-14T04:53:03.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dac9767-4d3c-405d-9681-92d0e76ef020 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78162024-11-14T04:53:03.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dac9767-4d3c-405d-9681-92d0e76ef020 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78172024-11-14T04:53:03.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8dac9767-4d3c-405d-9681-92d0e76ef020 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78182024-11-14T04:53:04.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c83aa66c-d992-41a0-951c-9f069d7756c4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78192024-11-14T04:53:04.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c83aa66c-d992-41a0-951c-9f069d7756c4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78202024-11-14T04:53:04.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c83aa66c-d992-41a0-951c-9f069d7756c4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78212024-11-14T04:53:05.259ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 00408cd0-c9ac-4d8c-890c-d81ef5378c96 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
78222024-11-14T04:53:05.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
78232024-11-14T04:53:05.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78242024-11-14T04:53:05.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
78252024-11-14T04:53:05.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78262024-11-14T04:53:05.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78272024-11-14T04:53:05.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78282024-11-14T04:53:05.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78292024-11-14T04:53:05.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78302024-11-14T04:53:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78312024-11-14T04:53:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78322024-11-14T04:53:05.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78332024-11-14T04:53:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78342024-11-14T04:53:05.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78352024-11-14T04:53:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78362024-11-14T04:53:05.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78372024-11-14T04:53:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
78382024-11-14T04:53:05.319ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78392024-11-14T04:53:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78402024-11-14T04:53:05.328ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
78412024-11-14T04:53:05.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.288478ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
78422024-11-14T04:53:05.340ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.409319ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78432024-11-14T04:53:05.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d01a9d36-9b5d-447b-a03b-723935f9c02b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78442024-11-14T04:53:05.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d01a9d36-9b5d-447b-a03b-723935f9c02b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78452024-11-14T04:53:05.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d01a9d36-9b5d-447b-a03b-723935f9c02b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78462024-11-14T04:53:06.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3962d934-fc24-4996-9199-8350259c695f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78472024-11-14T04:53:06.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3962d934-fc24-4996-9199-8350259c695f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78482024-11-14T04:53:06.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3962d934-fc24-4996-9199-8350259c695f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78492024-11-14T04:53:07.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dffa7f95-8247-4b54-ad1f-7cf2b6126e31 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78502024-11-14T04:53:07.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dffa7f95-8247-4b54-ad1f-7cf2b6126e31 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78512024-11-14T04:53:07.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dffa7f95-8247-4b54-ad1f-7cf2b6126e31 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78522024-11-14T04:53:08.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f308742-4a49-4cee-aa3f-dc17cf2a2207 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78532024-11-14T04:53:08.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f308742-4a49-4cee-aa3f-dc17cf2a2207 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78542024-11-14T04:53:08.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8f308742-4a49-4cee-aa3f-dc17cf2a2207 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78552024-11-14T04:53:09.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 236804ac-8333-4b4f-b8b8-7a090bef2bf7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78562024-11-14T04:53:09.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 236804ac-8333-4b4f-b8b8-7a090bef2bf7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78572024-11-14T04:53:09.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 236804ac-8333-4b4f-b8b8-7a090bef2bf7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78582024-11-14T04:53:10.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a2bb8ffa-ff5e-4e11-92d1-4d225f48f9b8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78592024-11-14T04:53:10.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a2bb8ffa-ff5e-4e11-92d1-4d225f48f9b8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78602024-11-14T04:53:10.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a2bb8ffa-ff5e-4e11-92d1-4d225f48f9b8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78612024-11-14T04:53:11.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f4b4680e-47aa-499d-9140-5684a8f35a59 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78622024-11-14T04:53:11.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f4b4680e-47aa-499d-9140-5684a8f35a59 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78632024-11-14T04:53:11.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f4b4680e-47aa-499d-9140-5684a8f35a59 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78642024-11-14T04:53:12.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = daeca1ae-f168-48f5-a1ee-0e56e3ce6cd9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78652024-11-14T04:53:12.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = daeca1ae-f168-48f5-a1ee-0e56e3ce6cd9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78662024-11-14T04:53:12.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = daeca1ae-f168-48f5-a1ee-0e56e3ce6cd9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78672024-11-14T04:53:13.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 84a0b253-b4c7-4596-a21d-c4d72db35012 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78682024-11-14T04:53:13.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 84a0b253-b4c7-4596-a21d-c4d72db35012 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78692024-11-14T04:53:13.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 84a0b253-b4c7-4596-a21d-c4d72db35012 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78702024-11-14T04:53:14.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ae2b3fdc-01df-4663-8e16-e281e4b22666 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78712024-11-14T04:53:14.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ae2b3fdc-01df-4663-8e16-e281e4b22666 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78722024-11-14T04:53:14.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ae2b3fdc-01df-4663-8e16-e281e4b22666 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
78732024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
78742024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78752024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
78762024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78772024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
78782024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78792024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
78802024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
78812024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78822024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78832024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78842024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
78852024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
78862024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78872024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78882024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
78892024-11-14T04:53:15.307ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78902024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78912024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
78922024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
78932024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78942024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
78952024-11-14T04:53:15.307ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:43:15.307752044 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
78962024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
78972024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
78982024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78992024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
79002024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
79012024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
79022024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
79032024-11-14T04:53:15.307ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
79042024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
79052024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.97\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
79062024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
79072024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
79082024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
79092024-11-14T04:53:15.307ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
79102024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79112024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
79122024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79132024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
79142024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
79152024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79162024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
79172024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79182024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79192024-11-14T04:53:15.307ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
79202024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
79212024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79222024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79232024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
79242024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
79252024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
79262024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79272024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
79282024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
79292024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
79302024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79312024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
79322024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
79332024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
79342024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79352024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79362024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79372024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79382024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79392024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79402024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79412024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79422024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79432024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79442024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
79452024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79462024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
79472024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
79482024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79492024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
79502024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
79512024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79522024-11-14T04:53:15.308ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 83102500 } })
79532024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79542024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
79552024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79562024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79572024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79582024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79592024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79602024-11-14T04:53:15.308ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 83299806 } })
79612024-11-14T04:53:15.308ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
79622024-11-14T04:53:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.266016ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
79632024-11-14T04:53:15.309ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
79642024-11-14T04:53:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.073331ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
79652024-11-14T04:53:15.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79662024-11-14T04:53:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79672024-11-14T04:53:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.178482ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79682024-11-14T04:53:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79692024-11-14T04:53:15.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79702024-11-14T04:53:15.311ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 86532640 } })
79712024-11-14T04:53:15.312ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
79722024-11-14T04:53:15.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79732024-11-14T04:53:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79742024-11-14T04:53:15.314ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79752024-11-14T04:53:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79762024-11-14T04:53:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79772024-11-14T04:53:15.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79782024-11-14T04:53:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79792024-11-14T04:53:15.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79802024-11-14T04:53:15.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79812024-11-14T04:53:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79822024-11-14T04:53:15.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79832024-11-14T04:53:15.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.66131ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
79842024-11-14T04:53:15.317ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79852024-11-14T04:53:15.319ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:43:15.307752044 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
79862024-11-14T04:53:15.319ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.324068ms iteration = 8 status = {"expiration":"2024-11-14T04:43:15.307752044Z","pruned":[]}
79872024-11-14T04:53:15.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79882024-11-14T04:53:15.319ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79892024-11-14T04:53:15.319ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
79902024-11-14T04:53:15.319ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
79912024-11-14T04:53:15.319ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.910615ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
79922024-11-14T04:53:15.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79932024-11-14T04:53:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
79942024-11-14T04:53:15.320ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
79952024-11-14T04:53:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
79962024-11-14T04:53:15.321ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 96414546 } })
79972024-11-14T04:53:15.322ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
79982024-11-14T04:53:15.323ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.318034ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
79992024-11-14T04:53:15.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80002024-11-14T04:53:15.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80012024-11-14T04:53:15.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80022024-11-14T04:53:15.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80032024-11-14T04:53:15.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80042024-11-14T04:53:15.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80052024-11-14T04:53:15.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80062024-11-14T04:53:15.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80072024-11-14T04:53:15.326ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80082024-11-14T04:53:15.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80092024-11-14T04:53:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80102024-11-14T04:53:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80112024-11-14T04:53:15.327ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122024-11-14T04:53:15.328ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80132024-11-14T04:53:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80142024-11-14T04:53:15.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80152024-11-14T04:53:15.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80162024-11-14T04:53:15.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80172024-11-14T04:53:15.331ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80182024-11-14T04:53:15.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80192024-11-14T04:53:15.333ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80202024-11-14T04:53:15.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80212024-11-14T04:53:15.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80222024-11-14T04:53:15.335ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80232024-11-14T04:53:15.335ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.456115ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80242024-11-14T04:53:15.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80252024-11-14T04:53:15.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80262024-11-14T04:53:15.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80272024-11-14T04:53:15.344ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80282024-11-14T04:53:15.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80292024-11-14T04:53:15.346ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80302024-11-14T04:53:15.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80312024-11-14T04:53:15.353ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80322024-11-14T04:53:15.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80332024-11-14T04:53:15.355ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1374, tv_nsec: 130162453 } })
80342024-11-14T04:53:15.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
80352024-11-14T04:53:15.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80362024-11-14T04:53:15.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80372024-11-14T04:53:15.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.234305ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80382024-11-14T04:53:15.357ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80392024-11-14T04:53:15.357ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80402024-11-14T04:53:15.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80412024-11-14T04:53:15.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80422024-11-14T04:53:15.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80432024-11-14T04:53:15.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80442024-11-14T04:53:15.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80452024-11-14T04:53:15.361ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80462024-11-14T04:53:15.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80472024-11-14T04:53:15.364ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80482024-11-14T04:53:15.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80492024-11-14T04:53:15.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
80502024-11-14T04:53:15.367ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80512024-11-14T04:53:15.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80522024-11-14T04:53:15.372ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80532024-11-14T04:53:15.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80542024-11-14T04:53:15.390ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80552024-11-14T04:53:15.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80562024-11-14T04:53:15.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80572024-11-14T04:53:15.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80582024-11-14T04:53:15.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 94.857637ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
80592024-11-14T04:53:15.409ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80602024-11-14T04:53:15.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80612024-11-14T04:53:15.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 108.184833ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80622024-11-14T04:53:15.416ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
80632024-11-14T04:53:15.416ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
80642024-11-14T04:53:15.416ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
80652024-11-14T04:53:15.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80662024-11-14T04:53:15.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80672024-11-14T04:53:15.429ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80682024-11-14T04:53:15.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80692024-11-14T04:53:15.430ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
80702024-11-14T04:53:15.430ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
80712024-11-14T04:53:15.430ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.916879ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
80722024-11-14T04:53:15.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80732024-11-14T04:53:15.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80742024-11-14T04:53:15.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
80752024-11-14T04:53:15.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80762024-11-14T04:53:15.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
80772024-11-14T04:53:15.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80782024-11-14T04:53:15.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80792024-11-14T04:53:15.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80802024-11-14T04:53:15.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80812024-11-14T04:53:15.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80822024-11-14T04:53:15.467ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80832024-11-14T04:53:15.467ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80842024-11-14T04:53:15.467ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80852024-11-14T04:53:15.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80862024-11-14T04:53:15.476ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80872024-11-14T04:53:15.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80882024-11-14T04:53:15.485ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
80892024-11-14T04:53:15.485ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 177.51547ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
80902024-11-14T04:53:15.522ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
80912024-11-14T04:53:15.522ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
80922024-11-14T04:53:15.522ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
80932024-11-14T04:53:15.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80942024-11-14T04:53:15.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80952024-11-14T04:53:15.544ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
80962024-11-14T04:53:15.544ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80972024-11-14T04:53:15.545ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dfd3c5d-ed27-4d54-a63f-3c912a3b802a", "content-length": "26", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
80982024-11-14T04:53:15.545ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80992024-11-14T04:53:15.547ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81002024-11-14T04:53:15.557ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
81012024-11-14T04:53:15.575ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
81022024-11-14T04:53:15.577ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81032024-11-14T04:53:15.577ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81042024-11-14T04:53:15.578ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "253c77ca-eddb-488e-af38-d057a5ba82a8", "content-length": "372", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
81052024-11-14T04:53:15.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81062024-11-14T04:53:15.579ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
81072024-11-14T04:53:15.579ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81082024-11-14T04:53:15.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81092024-11-14T04:53:15.579ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7d687b4-04a2-46e6-a836-14bd4323551c", "content-length": "26", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
81102024-11-14T04:53:15.579ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81112024-11-14T04:53:15.584ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
81122024-11-14T04:53:15.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81132024-11-14T04:53:15.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81142024-11-14T04:53:15.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81152024-11-14T04:53:15.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81162024-11-14T04:53:15.587ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81172024-11-14T04:53:15.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81182024-11-14T04:53:15.592ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81192024-11-14T04:53:15.592ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 284.831639ms iteration = 17 status = {"physical_disks_added":0}
81202024-11-14T04:53:15.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81212024-11-14T04:53:15.594ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81222024-11-14T04:53:15.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81232024-11-14T04:53:15.611ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
81242024-11-14T04:53:15.611ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 303.825769ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
81252024-11-14T04:53:15.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 319.639156ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
81262024-11-14T04:53:15.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 319.77669ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
81272024-11-14T04:53:15.633ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81282024-11-14T04:53:15.633ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81292024-11-14T04:53:15.633ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 325.425714ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81302024-11-14T04:53:15.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81312024-11-14T04:53:15.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81322024-11-14T04:53:15.637ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81332024-11-14T04:53:15.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
81342024-11-14T04:53:15.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81352024-11-14T04:53:15.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81362024-11-14T04:53:15.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81372024-11-14T04:53:15.638ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81382024-11-14T04:53:15.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81392024-11-14T04:53:15.639ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 331.626284ms iteration = 15 status = 0
81402024-11-14T04:53:15.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
81412024-11-14T04:53:15.641ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81422024-11-14T04:53:15.642ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0181a57-7d69-463a-99f8-1af327c434b6", "content-length": "26", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
81432024-11-14T04:53:15.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81442024-11-14T04:53:15.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81452024-11-14T04:53:15.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81462024-11-14T04:53:15.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81472024-11-14T04:53:15.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81482024-11-14T04:53:15.662ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
81492024-11-14T04:53:15.662ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81502024-11-14T04:53:15.663ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "deff4467-467c-4fb5-ae72-8289cf7b5b97", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
81512024-11-14T04:53:15.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81522024-11-14T04:53:15.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81532024-11-14T04:53:15.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81542024-11-14T04:53:15.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81552024-11-14T04:53:15.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81562024-11-14T04:53:15.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81572024-11-14T04:53:15.676ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81582024-11-14T04:53:15.676ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81592024-11-14T04:53:15.677ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4a999afa-9040-4993-ae6e-34b806e4d92c", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
81602024-11-14T04:53:15.679ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 371.925461ms iteration = 15 status = {}
81612024-11-14T04:53:15.680ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
81622024-11-14T04:53:15.680ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
81632024-11-14T04:53:15.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81642024-11-14T04:53:15.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81652024-11-14T04:53:15.688ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
81662024-11-14T04:53:15.688ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
81672024-11-14T04:53:15.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81682024-11-14T04:53:15.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81692024-11-14T04:53:15.704ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 396.960486ms iteration = 15 status = {}
81702024-11-14T04:53:15.720ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
81712024-11-14T04:53:15.720ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 412.627869ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
81722024-11-14T04:53:15.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81732024-11-14T04:53:15.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81742024-11-14T04:53:15.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81752024-11-14T04:53:15.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81762024-11-14T04:53:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81772024-11-14T04:53:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81782024-11-14T04:53:15.727ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81792024-11-14T04:53:15.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81802024-11-14T04:53:15.734ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
81812024-11-14T04:53:15.735ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
81822024-11-14T04:53:15.735ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ac0dc5b0-e438-408f-bb93-c39408483d72", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81832024-11-14T04:53:15.735ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81842024-11-14T04:53:15.737ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1882133f-8437-418b-a731-0586c1066769", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81852024-11-14T04:53:15.737ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81862024-11-14T04:53:15.739ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
81872024-11-14T04:53:15.739ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 431.361792ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
81882024-11-14T04:53:15.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 359b65f8-2e0e-46ed-9108-ebaf0d4147e6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
81892024-11-14T04:53:15.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 359b65f8-2e0e-46ed-9108-ebaf0d4147e6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
81902024-11-14T04:53:15.778ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81912024-11-14T04:53:15.778ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4730562-6112-4992-a7fc-11c5cd098e9e", "content-length": "1", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
81922024-11-14T04:53:15.780ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81932024-11-14T04:53:15.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81942024-11-14T04:53:15.808ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81952024-11-14T04:53:15.808ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9faf322b-8a02-4c1a-b9ac-057d9d7f0dbb", "content-length": "691", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
81962024-11-14T04:53:15.809ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
81972024-11-14T04:53:15.809ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81982024-11-14T04:53:15.809ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81992024-11-14T04:53:15.810ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 502.931283ms iteration = 15 status = {}
82002024-11-14T04:53:15.811ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
82012024-11-14T04:53:15.811ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
82022024-11-14T04:53:15.811ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
82032024-11-14T04:53:15.811ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 503.756927ms iteration = 8 status = {"generation":2}
82042024-11-14T04:53:15.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 359b65f8-2e0e-46ed-9108-ebaf0d4147e6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82052024-11-14T04:53:15.812ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 504.575641ms iteration = 15 status = null
82062024-11-14T04:53:15.812ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
82072024-11-14T04:53:15.812ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
82082024-11-14T04:53:15.812ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
82092024-11-14T04:53:15.812ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 504.5487ms iteration = 8 status = {"generation":1}
82102024-11-14T04:53:15.826ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
82112024-11-14T04:53:15.826ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c06ff961-322c-4740-bc99-154eee686a63", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
82122024-11-14T04:53:15.826ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
82132024-11-14T04:53:15.829ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4f45cbe0-db73-4c20-9346-613888d23d7d", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
82142024-11-14T04:53:15.829ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
82152024-11-14T04:53:15.831ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fcff7226-afda-4dfa-b09c-425e31a26b61", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
82162024-11-14T04:53:15.831ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
82172024-11-14T04:53:15.833ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
82182024-11-14T04:53:15.833ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 525.25674ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
82192024-11-14T04:53:15.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82202024-11-14T04:53:15.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82212024-11-14T04:53:15.869ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
82222024-11-14T04:53:15.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82232024-11-14T04:53:15.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82242024-11-14T04:53:15.879ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82252024-11-14T04:53:15.879ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe5ec11-3a88-419f-8709-de42b6ba0667", "content-length": "134", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
82262024-11-14T04:53:15.879ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
82272024-11-14T04:53:15.879ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
82282024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82292024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82302024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82312024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82322024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82332024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82342024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82352024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82362024-11-14T04:53:15.880ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
82372024-11-14T04:53:15.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82382024-11-14T04:53:15.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82392024-11-14T04:53:15.882ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82402024-11-14T04:53:15.882ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "57bd0992-f314-453e-a5b3-e522a800cb00", "content-length": "2", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
82412024-11-14T04:53:15.882ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82422024-11-14T04:53:15.882ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc5a6f9a-929b-4966-a529-ca6dcc7e97c2", "content-length": "51", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
82432024-11-14T04:53:15.882ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
82442024-11-14T04:53:15.882ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82452024-11-14T04:53:15.975ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5970e6ed-cd02-41c6-b607-8a1f361e7671", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
82462024-11-14T04:53:15.975ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
82472024-11-14T04:53:15.975ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82482024-11-14T04:53:15.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e60410d-3578-4594-bf97-14dbb5a3b83e", "content-length": "682", "date": "Thu, 14 Nov 2024 04:53:15 GMT"} })
82492024-11-14T04:53:15.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82502024-11-14T04:53:15.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82512024-11-14T04:53:15.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82522024-11-14T04:53:15.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82532024-11-14T04:53:15.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82542024-11-14T04:53:15.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82552024-11-14T04:53:15.988ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82562024-11-14T04:53:15.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82572024-11-14T04:53:15.996ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 688.193209ms iteration = 15 status = {}
82582024-11-14T04:53:16.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 8bc7757c-e410-4922-87b9-106e9da29560 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
82592024-11-14T04:53:16.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 8bc7757c-e410-4922-87b9-106e9da29560 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
82602024-11-14T04:53:16.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 8bc7757c-e410-4922-87b9-106e9da29560 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
82612024-11-14T04:53:16.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41d8df9d-2575-414b-abc5-b48ffbae75b4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82622024-11-14T04:53:16.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41d8df9d-2575-414b-abc5-b48ffbae75b4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82632024-11-14T04:53:16.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41d8df9d-2575-414b-abc5-b48ffbae75b4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82642024-11-14T04:53:17.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 182d4c73-f73a-4155-991c-b867494285b9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82652024-11-14T04:53:17.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 182d4c73-f73a-4155-991c-b867494285b9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82662024-11-14T04:53:17.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 182d4c73-f73a-4155-991c-b867494285b9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82672024-11-14T04:53:18.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b38e0698-7bd9-4292-8eeb-148ddbd68916 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82682024-11-14T04:53:18.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b38e0698-7bd9-4292-8eeb-148ddbd68916 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82692024-11-14T04:53:18.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b38e0698-7bd9-4292-8eeb-148ddbd68916 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82702024-11-14T04:53:19.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f8dffdeb-d9f5-4f91-ba03-a1e8feeadbb5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82712024-11-14T04:53:19.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f8dffdeb-d9f5-4f91-ba03-a1e8feeadbb5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82722024-11-14T04:53:19.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f8dffdeb-d9f5-4f91-ba03-a1e8feeadbb5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82732024-11-14T04:53:20.259ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 583 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = c0c79663-9356-4c75-955d-3850bad1abeb response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
82742024-11-14T04:53:20.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40b219e8-123b-4725-96b4-affd0f47ed33 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82752024-11-14T04:53:20.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40b219e8-123b-4725-96b4-affd0f47ed33 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82762024-11-14T04:53:20.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40b219e8-123b-4725-96b4-affd0f47ed33 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82772024-11-14T04:53:21.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 278bb600-fa53-4b06-b592-3fe803ad7be6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82782024-11-14T04:53:21.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 278bb600-fa53-4b06-b592-3fe803ad7be6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82792024-11-14T04:53:21.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 278bb600-fa53-4b06-b592-3fe803ad7be6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82802024-11-14T04:53:22.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e88749cc-d7b4-4c45-9652-378bfacf795e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82812024-11-14T04:53:22.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e88749cc-d7b4-4c45-9652-378bfacf795e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82822024-11-14T04:53:22.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e88749cc-d7b4-4c45-9652-378bfacf795e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82832024-11-14T04:53:23.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 98927af5-6492-4e7b-ad3f-e9ce5e4bad41 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82842024-11-14T04:53:23.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 98927af5-6492-4e7b-ad3f-e9ce5e4bad41 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82852024-11-14T04:53:23.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 98927af5-6492-4e7b-ad3f-e9ce5e4bad41 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82862024-11-14T04:53:25.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 664e1cc9-3a70-40ad-ba67-0a8baf54993b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82872024-11-14T04:53:25.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 664e1cc9-3a70-40ad-ba67-0a8baf54993b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82882024-11-14T04:53:25.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 664e1cc9-3a70-40ad-ba67-0a8baf54993b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
82892024-11-14T04:53:25.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
82902024-11-14T04:53:25.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
82912024-11-14T04:53:25.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82922024-11-14T04:53:25.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82932024-11-14T04:53:25.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82942024-11-14T04:53:25.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82952024-11-14T04:53:25.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82962024-11-14T04:53:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82972024-11-14T04:53:25.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82982024-11-14T04:53:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82992024-11-14T04:53:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83002024-11-14T04:53:25.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83012024-11-14T04:53:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83022024-11-14T04:53:25.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
83032024-11-14T04:53:25.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83042024-11-14T04:53:25.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83052024-11-14T04:53:25.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
83062024-11-14T04:53:25.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.903253ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
83072024-11-14T04:53:25.336ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83082024-11-14T04:53:25.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83092024-11-14T04:53:25.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.606282ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83102024-11-14T04:53:26.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 63a18d02-82ad-458e-b948-6a0aa650f8e0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83112024-11-14T04:53:26.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 63a18d02-82ad-458e-b948-6a0aa650f8e0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83122024-11-14T04:53:26.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 63a18d02-82ad-458e-b948-6a0aa650f8e0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83132024-11-14T04:53:27.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f20b8fc9-875e-48ed-ab09-541aa447b8d7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83142024-11-14T04:53:27.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f20b8fc9-875e-48ed-ab09-541aa447b8d7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83152024-11-14T04:53:27.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f20b8fc9-875e-48ed-ab09-541aa447b8d7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83162024-11-14T04:53:28.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dc171a82-20c8-48aa-9107-79bc72dca37d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83172024-11-14T04:53:28.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dc171a82-20c8-48aa-9107-79bc72dca37d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83182024-11-14T04:53:28.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dc171a82-20c8-48aa-9107-79bc72dca37d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83192024-11-14T04:53:29.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc982102-3a12-4507-bec1-c1def3497d68 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83202024-11-14T04:53:29.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc982102-3a12-4507-bec1-c1def3497d68 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83212024-11-14T04:53:29.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc982102-3a12-4507-bec1-c1def3497d68 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83222024-11-14T04:53:30.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 377d33e0-2083-4bfe-afeb-950991d06ad3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83232024-11-14T04:53:30.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 377d33e0-2083-4bfe-afeb-950991d06ad3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83242024-11-14T04:53:30.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 377d33e0-2083-4bfe-afeb-950991d06ad3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83252024-11-14T04:53:31.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dbe961f6-b848-4521-982f-ebc82eabaddf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83262024-11-14T04:53:31.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dbe961f6-b848-4521-982f-ebc82eabaddf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83272024-11-14T04:53:31.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dbe961f6-b848-4521-982f-ebc82eabaddf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83282024-11-14T04:53:32.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0a6fc17-f985-4445-a40e-60248fbb11de roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83292024-11-14T04:53:32.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0a6fc17-f985-4445-a40e-60248fbb11de resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83302024-11-14T04:53:32.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0a6fc17-f985-4445-a40e-60248fbb11de response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83312024-11-14T04:53:33.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 485c45d3-1127-4c79-a347-6575f4853f15 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83322024-11-14T04:53:33.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 485c45d3-1127-4c79-a347-6575f4853f15 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83332024-11-14T04:53:33.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 485c45d3-1127-4c79-a347-6575f4853f15 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83342024-11-14T04:53:34.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eea89c96-4280-4473-8140-a6ff7c50f35c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83352024-11-14T04:53:34.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eea89c96-4280-4473-8140-a6ff7c50f35c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83362024-11-14T04:53:34.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = eea89c96-4280-4473-8140-a6ff7c50f35c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83372024-11-14T04:53:35.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f5eea954-f70a-4781-8d3b-3458f072b63b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83382024-11-14T04:53:35.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f5eea954-f70a-4781-8d3b-3458f072b63b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83392024-11-14T04:53:35.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f5eea954-f70a-4781-8d3b-3458f072b63b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83402024-11-14T04:53:35.258ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 500 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 9fad4da9-14f8-4beb-9abd-8f45f8ef50b0 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
83412024-11-14T04:53:35.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
83422024-11-14T04:53:35.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83432024-11-14T04:53:35.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
83442024-11-14T04:53:35.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83452024-11-14T04:53:35.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83462024-11-14T04:53:35.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83472024-11-14T04:53:35.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83482024-11-14T04:53:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83492024-11-14T04:53:35.337ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83502024-11-14T04:53:35.339ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.973177ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83512024-11-14T04:53:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83522024-11-14T04:53:35.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83532024-11-14T04:53:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83542024-11-14T04:53:35.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83552024-11-14T04:53:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83562024-11-14T04:53:35.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83572024-11-14T04:53:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
83582024-11-14T04:53:35.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83592024-11-14T04:53:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83602024-11-14T04:53:35.393ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
83612024-11-14T04:53:35.393ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.555617ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
83622024-11-14T04:53:36.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a144f3b-38da-4aea-ac57-714ecb47854d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83632024-11-14T04:53:36.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a144f3b-38da-4aea-ac57-714ecb47854d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83642024-11-14T04:53:36.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a144f3b-38da-4aea-ac57-714ecb47854d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83652024-11-14T04:53:37.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dc0510c7-0533-4703-9a68-88c521c493f4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83662024-11-14T04:53:37.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dc0510c7-0533-4703-9a68-88c521c493f4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83672024-11-14T04:53:37.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dc0510c7-0533-4703-9a68-88c521c493f4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83682024-11-14T04:53:38.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef18a4b3-ee71-483a-bc07-dba11e40249f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83692024-11-14T04:53:38.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef18a4b3-ee71-483a-bc07-dba11e40249f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83702024-11-14T04:53:38.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef18a4b3-ee71-483a-bc07-dba11e40249f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83712024-11-14T04:53:39.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e3cbbe98-63b7-4a9f-8476-171ca749ed95 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83722024-11-14T04:53:39.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e3cbbe98-63b7-4a9f-8476-171ca749ed95 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83732024-11-14T04:53:39.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e3cbbe98-63b7-4a9f-8476-171ca749ed95 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83742024-11-14T04:53:40.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd3c8e28-166f-44cb-992b-b480461e32d1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83752024-11-14T04:53:40.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd3c8e28-166f-44cb-992b-b480461e32d1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83762024-11-14T04:53:40.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd3c8e28-166f-44cb-992b-b480461e32d1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83772024-11-14T04:53:41.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6c61a3bc-06ba-44b8-9e0f-e08d782ae2f0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83782024-11-14T04:53:41.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6c61a3bc-06ba-44b8-9e0f-e08d782ae2f0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83792024-11-14T04:53:41.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6c61a3bc-06ba-44b8-9e0f-e08d782ae2f0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83802024-11-14T04:53:42.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee48b3b0-e74b-46e6-870c-9390f235651c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83812024-11-14T04:53:42.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee48b3b0-e74b-46e6-870c-9390f235651c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83822024-11-14T04:53:42.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee48b3b0-e74b-46e6-870c-9390f235651c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83832024-11-14T04:53:43.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bd15fe0a-4457-4ea6-ac73-5f378a581720 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83842024-11-14T04:53:43.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bd15fe0a-4457-4ea6-ac73-5f378a581720 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83852024-11-14T04:53:43.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bd15fe0a-4457-4ea6-ac73-5f378a581720 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83862024-11-14T04:53:44.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b17bbdb0-8409-4216-9f51-d69911a09b30 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83872024-11-14T04:53:44.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b17bbdb0-8409-4216-9f51-d69911a09b30 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83882024-11-14T04:53:44.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b17bbdb0-8409-4216-9f51-d69911a09b30 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
83892024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
83902024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83912024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
83922024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
83932024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83942024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83952024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
83962024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83972024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
83982024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
83992024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84002024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
84012024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
84022024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
84032024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84042024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84052024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
84062024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84072024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84082024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
84092024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84102024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
84112024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
84122024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
84132024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84142024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
84152024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84162024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
84172024-11-14T04:53:45.308ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84182024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84192024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
84202024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
84212024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84222024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84232024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84242024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84252024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84262024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84272024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84282024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84292024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84302024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84312024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84322024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84332024-11-14T04:53:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84342024-11-14T04:53:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84352024-11-14T04:53:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84362024-11-14T04:53:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84372024-11-14T04:53:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84382024-11-14T04:53:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84392024-11-14T04:53:45.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84402024-11-14T04:53:45.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84412024-11-14T04:53:45.311ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 86774183 } })
84422024-11-14T04:53:45.311ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.677456ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84432024-11-14T04:53:45.312ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
84442024-11-14T04:53:45.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84452024-11-14T04:53:45.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84462024-11-14T04:53:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84472024-11-14T04:53:45.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84482024-11-14T04:53:45.313ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 88535384 } })
84492024-11-14T04:53:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84502024-11-14T04:53:45.313ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
84512024-11-14T04:53:45.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84522024-11-14T04:53:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84532024-11-14T04:53:45.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84542024-11-14T04:53:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84552024-11-14T04:53:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84562024-11-14T04:53:45.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84572024-11-14T04:53:45.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84582024-11-14T04:53:45.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84592024-11-14T04:53:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84602024-11-14T04:53:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84612024-11-14T04:53:45.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84622024-11-14T04:53:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84632024-11-14T04:53:45.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84642024-11-14T04:53:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84652024-11-14T04:53:45.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84662024-11-14T04:53:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84672024-11-14T04:53:45.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84682024-11-14T04:53:45.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84692024-11-14T04:53:45.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84702024-11-14T04:53:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84712024-11-14T04:53:45.325ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1404, tv_nsec: 100701896 } })
84722024-11-14T04:53:45.326ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
84732024-11-14T04:53:45.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84742024-11-14T04:53:45.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
84752024-11-14T04:53:45.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84762024-11-14T04:53:45.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84772024-11-14T04:53:45.367ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84782024-11-14T04:53:45.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84792024-11-14T04:53:45.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
84802024-11-14T04:53:45.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.575363ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
84812024-11-14T04:53:45.370ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84822024-11-14T04:53:45.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84832024-11-14T04:53:45.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84842024-11-14T04:53:45.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84852024-11-14T04:53:45.378ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.904885ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84862024-11-14T04:53:45.380ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84872024-11-14T04:53:45.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84882024-11-14T04:53:45.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84892024-11-14T04:53:45.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.411696ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
84902024-11-14T04:53:45.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84912024-11-14T04:53:45.382ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84922024-11-14T04:53:45.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84932024-11-14T04:53:45.384ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.694232ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
84942024-11-14T04:53:45.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84952024-11-14T04:53:45.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84962024-11-14T04:53:45.385ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84972024-11-14T04:53:45.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84982024-11-14T04:53:45.387ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84992024-11-14T04:53:45.387ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85002024-11-14T04:53:45.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85012024-11-14T04:53:45.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85022024-11-14T04:53:45.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85032024-11-14T04:53:45.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85042024-11-14T04:53:45.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85052024-11-14T04:53:45.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85062024-11-14T04:53:45.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85072024-11-14T04:53:45.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85082024-11-14T04:53:45.391ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85092024-11-14T04:53:45.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85102024-11-14T04:53:45.403ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85112024-11-14T04:53:45.403ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.96415ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85122024-11-14T04:53:45.409ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
85132024-11-14T04:53:45.409ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85142024-11-14T04:53:45.410ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "26f105c8-cded-4960-ac63-6c691c8b0a7c", "content-length": "26", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
85152024-11-14T04:53:45.410ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85162024-11-14T04:53:45.412ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
85172024-11-14T04:53:45.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85182024-11-14T04:53:45.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85192024-11-14T04:53:45.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85202024-11-14T04:53:45.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85212024-11-14T04:53:45.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85222024-11-14T04:53:45.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
85232024-11-14T04:53:45.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85242024-11-14T04:53:45.453ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85252024-11-14T04:53:45.453ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85262024-11-14T04:53:45.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85272024-11-14T04:53:45.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85282024-11-14T04:53:45.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85292024-11-14T04:53:45.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 145.905426ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
85302024-11-14T04:53:45.455ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.803271ms iteration = 16 status = 0
85312024-11-14T04:53:45.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 147.368748ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85322024-11-14T04:53:45.457ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
85332024-11-14T04:53:45.457ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85342024-11-14T04:53:45.457ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4b74a99-c018-4e53-8ca9-fec5df2f5850", "content-length": "26", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
85352024-11-14T04:53:45.457ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85362024-11-14T04:53:45.459ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85372024-11-14T04:53:45.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e05e305e-af0e-4634-a899-75d013df4036 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
85382024-11-14T04:53:45.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e05e305e-af0e-4634-a899-75d013df4036 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
85392024-11-14T04:53:45.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e05e305e-af0e-4634-a899-75d013df4036 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
85402024-11-14T04:53:45.480ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
85412024-11-14T04:53:45.480ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85422024-11-14T04:53:45.481ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5088a30c-44a0-4ecc-ab8c-67f527894687", "content-length": "26", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
85432024-11-14T04:53:45.481ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85442024-11-14T04:53:45.483ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85452024-11-14T04:53:45.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 191.016011ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85462024-11-14T04:53:45.508ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85472024-11-14T04:53:45.508ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85482024-11-14T04:53:45.508ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 199.62013ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85492024-11-14T04:53:45.545ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 236.724475ms iteration = 18 status = {"physical_disks_added":0}
85502024-11-14T04:53:45.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85512024-11-14T04:53:45.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85522024-11-14T04:53:45.581ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85532024-11-14T04:53:45.582ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fb1aa6d-21f1-48ee-bc0d-5415b6fc36f4", "content-length": "1", "date": "Thu, 14 Nov 2024 04:53:44 GMT"} })
85542024-11-14T04:53:45.584ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85552024-11-14T04:53:45.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85562024-11-14T04:53:45.585ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 277.496676ms iteration = 16 status = {}
85572024-11-14T04:53:45.621ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85582024-11-14T04:53:45.621ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85592024-11-14T04:53:45.621ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "16565915-c018-41fc-a311-34c7375c807c", "content-length": "372", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
85602024-11-14T04:53:45.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85612024-11-14T04:53:45.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85622024-11-14T04:53:45.624ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 315.841387ms iteration = 16 status = null
85632024-11-14T04:53:45.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85642024-11-14T04:53:45.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85652024-11-14T04:53:45.640ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
85662024-11-14T04:53:45.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85672024-11-14T04:53:45.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85682024-11-14T04:53:45.649ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85692024-11-14T04:53:45.650ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed60b465-63aa-4118-90ad-14a7df966ecb", "content-length": "134", "date": "Thu, 14 Nov 2024 04:53:44 GMT"} })
85702024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85712024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
85722024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85732024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85742024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85752024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85762024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85772024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85782024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85792024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85802024-11-14T04:53:45.650ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85812024-11-14T04:53:45.650ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
85822024-11-14T04:53:45.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85832024-11-14T04:53:45.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85842024-11-14T04:53:45.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85852024-11-14T04:53:45.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85862024-11-14T04:53:45.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85872024-11-14T04:53:45.653ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85882024-11-14T04:53:45.653ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "641d7852-c773-4a2a-9373-5187d40d14bc", "content-length": "2", "date": "Thu, 14 Nov 2024 04:53:44 GMT"} })
85892024-11-14T04:53:45.653ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85902024-11-14T04:53:45.653ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "565dc9b9-881d-4185-becf-9971b1aa0c68", "content-length": "51", "date": "Thu, 14 Nov 2024 04:53:44 GMT"} })
85912024-11-14T04:53:45.653ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
85922024-11-14T04:53:45.653ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85932024-11-14T04:53:45.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85942024-11-14T04:53:45.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85952024-11-14T04:53:45.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85962024-11-14T04:53:45.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85972024-11-14T04:53:45.662ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
85982024-11-14T04:53:45.662ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85992024-11-14T04:53:45.764ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b7e422bb-d7fe-4f24-9a45-90e9710f6ee4", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
86002024-11-14T04:53:45.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86012024-11-14T04:53:45.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86022024-11-14T04:53:45.766ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86032024-11-14T04:53:45.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86042024-11-14T04:53:45.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86052024-11-14T04:53:45.770ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "835839e0-563e-435f-a8a5-f2f3fb65531e", "content-length": "691", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
86062024-11-14T04:53:45.770ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
86072024-11-14T04:53:45.770ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
86082024-11-14T04:53:45.770ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
86092024-11-14T04:53:45.772ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 463.648577ms iteration = 16 status = {}
86102024-11-14T04:53:45.772ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86112024-11-14T04:53:45.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86122024-11-14T04:53:45.775ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86132024-11-14T04:53:45.775ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86142024-11-14T04:53:45.776ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4501d3aa-e520-46f9-8f27-cea5b8116de1", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
86152024-11-14T04:53:45.777ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 469.422784ms iteration = 16 status = {}
86162024-11-14T04:53:45.874ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cc3ed664-b84b-44f3-ae58-1c0b360b91a3", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
86172024-11-14T04:53:45.874ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
86182024-11-14T04:53:45.874ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86192024-11-14T04:53:45.879ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3ae69f3-ad8d-46df-9a10-07683f3c7ce0", "content-length": "682", "date": "Thu, 14 Nov 2024 04:53:45 GMT"} })
86202024-11-14T04:53:45.879ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86212024-11-14T04:53:45.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86222024-11-14T04:53:45.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86232024-11-14T04:53:45.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86242024-11-14T04:53:45.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86252024-11-14T04:53:45.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86262024-11-14T04:53:45.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86272024-11-14T04:53:45.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86282024-11-14T04:53:45.897ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 588.854783ms iteration = 16 status = {}
86292024-11-14T04:53:46.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9375118-071c-49b8-8f91-d98b2502ec20 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86302024-11-14T04:53:46.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9375118-071c-49b8-8f91-d98b2502ec20 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86312024-11-14T04:53:46.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e9375118-071c-49b8-8f91-d98b2502ec20 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86322024-11-14T04:53:46.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c9c7b586-0fd4-453f-8672-fa5bcc1cfc33 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
86332024-11-14T04:53:46.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c9c7b586-0fd4-453f-8672-fa5bcc1cfc33 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
86342024-11-14T04:53:46.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c9c7b586-0fd4-453f-8672-fa5bcc1cfc33 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
86352024-11-14T04:53:47.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c79e25a7-325e-4278-b87d-8e58380aa517 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86362024-11-14T04:53:47.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c79e25a7-325e-4278-b87d-8e58380aa517 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86372024-11-14T04:53:47.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c79e25a7-325e-4278-b87d-8e58380aa517 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86382024-11-14T04:53:48.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4bc868ef-df81-4400-8539-1ffb8c829b4e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86392024-11-14T04:53:48.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4bc868ef-df81-4400-8539-1ffb8c829b4e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86402024-11-14T04:53:48.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4bc868ef-df81-4400-8539-1ffb8c829b4e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86412024-11-14T04:53:49.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6f481766-da02-45a7-bfa0-5cf87f1c9259 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86422024-11-14T04:53:49.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6f481766-da02-45a7-bfa0-5cf87f1c9259 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86432024-11-14T04:53:49.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6f481766-da02-45a7-bfa0-5cf87f1c9259 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86442024-11-14T04:53:50.259ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 758 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 9dcc3c8d-7ef9-4d79-8492-74cf475776fe response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
86452024-11-14T04:53:50.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d829a490-57ae-496f-ada6-aa7a63b2e6f4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86462024-11-14T04:53:50.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d829a490-57ae-496f-ada6-aa7a63b2e6f4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86472024-11-14T04:53:50.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d829a490-57ae-496f-ada6-aa7a63b2e6f4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86482024-11-14T04:53:51.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33977312-92d4-46ef-8631-3189c64e1aed roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86492024-11-14T04:53:51.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33977312-92d4-46ef-8631-3189c64e1aed resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86502024-11-14T04:53:51.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33977312-92d4-46ef-8631-3189c64e1aed response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86512024-11-14T04:53:52.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d9d2c1f-6224-4007-9fd1-3136ffef48d9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86522024-11-14T04:53:52.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d9d2c1f-6224-4007-9fd1-3136ffef48d9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86532024-11-14T04:53:52.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7d9d2c1f-6224-4007-9fd1-3136ffef48d9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86542024-11-14T04:53:53.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 862cd234-fa80-434c-a2e1-309ca2df9f31 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86552024-11-14T04:53:53.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 862cd234-fa80-434c-a2e1-309ca2df9f31 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86562024-11-14T04:53:53.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 862cd234-fa80-434c-a2e1-309ca2df9f31 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86572024-11-14T04:53:54.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c81ac2d1-e50c-4ab0-9546-d141e981abc6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86582024-11-14T04:53:54.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c81ac2d1-e50c-4ab0-9546-d141e981abc6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86592024-11-14T04:53:54.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c81ac2d1-e50c-4ab0-9546-d141e981abc6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86602024-11-14T04:53:55.308ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
86612024-11-14T04:53:55.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86622024-11-14T04:53:55.308ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
86632024-11-14T04:53:55.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86642024-11-14T04:53:55.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86652024-11-14T04:53:55.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86662024-11-14T04:53:55.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86672024-11-14T04:53:55.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86682024-11-14T04:53:55.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86692024-11-14T04:53:55.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86702024-11-14T04:53:55.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86712024-11-14T04:53:55.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86722024-11-14T04:53:55.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86732024-11-14T04:53:55.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
86742024-11-14T04:53:55.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86752024-11-14T04:53:55.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86762024-11-14T04:53:55.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
86772024-11-14T04:53:55.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.429439ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
86782024-11-14T04:53:55.341ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86792024-11-14T04:53:55.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86802024-11-14T04:53:55.372ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.57672ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86812024-11-14T04:53:55.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c2303f25-5054-487a-b122-41d863f908c0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86822024-11-14T04:53:55.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c2303f25-5054-487a-b122-41d863f908c0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86832024-11-14T04:53:55.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c2303f25-5054-487a-b122-41d863f908c0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86842024-11-14T04:53:56.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa378d1e-344f-4068-9374-b1291886bf71 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86852024-11-14T04:53:56.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa378d1e-344f-4068-9374-b1291886bf71 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86862024-11-14T04:53:56.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aa378d1e-344f-4068-9374-b1291886bf71 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86872024-11-14T04:53:57.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d857bb5f-5678-47cc-9c75-5289c6c813b4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86882024-11-14T04:53:57.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d857bb5f-5678-47cc-9c75-5289c6c813b4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86892024-11-14T04:53:57.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d857bb5f-5678-47cc-9c75-5289c6c813b4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86902024-11-14T04:53:58.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 59e1d036-f31b-4eaa-aae7-c89aa28b4c3f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86912024-11-14T04:53:58.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 59e1d036-f31b-4eaa-aae7-c89aa28b4c3f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86922024-11-14T04:53:58.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 59e1d036-f31b-4eaa-aae7-c89aa28b4c3f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86932024-11-14T04:53:59.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 29ab911d-0ea9-416c-9f51-f072863a7770 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86942024-11-14T04:53:59.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 29ab911d-0ea9-416c-9f51-f072863a7770 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86952024-11-14T04:53:59.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 29ab911d-0ea9-416c-9f51-f072863a7770 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86962024-11-14T04:54:00.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 44d080e1-f55c-4aa6-8062-6a6ca3644158 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86972024-11-14T04:54:00.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 44d080e1-f55c-4aa6-8062-6a6ca3644158 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86982024-11-14T04:54:00.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 44d080e1-f55c-4aa6-8062-6a6ca3644158 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
86992024-11-14T04:54:01.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 883d9d03-fc39-4c79-a7a2-17c7a7821c2d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87002024-11-14T04:54:01.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 883d9d03-fc39-4c79-a7a2-17c7a7821c2d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87012024-11-14T04:54:01.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 883d9d03-fc39-4c79-a7a2-17c7a7821c2d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87022024-11-14T04:54:02.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 887e8127-d534-4e64-b0e5-38f13b7f3525 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87032024-11-14T04:54:02.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 887e8127-d534-4e64-b0e5-38f13b7f3525 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87042024-11-14T04:54:02.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 887e8127-d534-4e64-b0e5-38f13b7f3525 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87052024-11-14T04:54:03.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4db43c27-74fa-4e8d-99d7-7f9cac4cc8d7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87062024-11-14T04:54:03.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4db43c27-74fa-4e8d-99d7-7f9cac4cc8d7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87072024-11-14T04:54:03.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4db43c27-74fa-4e8d-99d7-7f9cac4cc8d7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87082024-11-14T04:54:04.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe683d43-77e7-4074-869b-f191eeea4ebc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87092024-11-14T04:54:04.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe683d43-77e7-4074-869b-f191eeea4ebc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87102024-11-14T04:54:04.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe683d43-77e7-4074-869b-f191eeea4ebc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87112024-11-14T04:54:05.259ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 733 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 1657af98-7745-4e6d-b88a-8fcd3c071ce6 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
87122024-11-14T04:54:05.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
87132024-11-14T04:54:05.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
87142024-11-14T04:54:05.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87152024-11-14T04:54:05.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87162024-11-14T04:54:05.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87172024-11-14T04:54:05.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87182024-11-14T04:54:05.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87192024-11-14T04:54:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87202024-11-14T04:54:05.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87212024-11-14T04:54:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87222024-11-14T04:54:05.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87232024-11-14T04:54:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87242024-11-14T04:54:05.336ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87252024-11-14T04:54:05.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87262024-11-14T04:54:05.338ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.752041ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87272024-11-14T04:54:05.340ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87282024-11-14T04:54:05.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
87292024-11-14T04:54:05.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87302024-11-14T04:54:05.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87312024-11-14T04:54:05.358ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
87322024-11-14T04:54:05.358ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.312626ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
87332024-11-14T04:54:05.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8d9a87af-0dca-4506-9192-2f4ce955f999 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87342024-11-14T04:54:05.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8d9a87af-0dca-4506-9192-2f4ce955f999 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87352024-11-14T04:54:05.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8d9a87af-0dca-4506-9192-2f4ce955f999 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87362024-11-14T04:54:06.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8712cb7d-bbc2-43c0-ba50-ffb808170e93 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87372024-11-14T04:54:06.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8712cb7d-bbc2-43c0-ba50-ffb808170e93 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87382024-11-14T04:54:06.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8712cb7d-bbc2-43c0-ba50-ffb808170e93 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87392024-11-14T04:54:07.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b2c33b4f-d0d6-43d5-8db3-1e1f74a30605 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87402024-11-14T04:54:07.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b2c33b4f-d0d6-43d5-8db3-1e1f74a30605 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87412024-11-14T04:54:07.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b2c33b4f-d0d6-43d5-8db3-1e1f74a30605 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87422024-11-14T04:54:08.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d3e09b50-a967-4869-975c-135cb5aaa519 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87432024-11-14T04:54:08.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d3e09b50-a967-4869-975c-135cb5aaa519 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87442024-11-14T04:54:08.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d3e09b50-a967-4869-975c-135cb5aaa519 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87452024-11-14T04:54:10.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9f5788e2-232d-422c-9254-356a2ab27f34 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87462024-11-14T04:54:10.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9f5788e2-232d-422c-9254-356a2ab27f34 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87472024-11-14T04:54:10.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9f5788e2-232d-422c-9254-356a2ab27f34 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87482024-11-14T04:54:11.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd8e2c03-8f8f-4a1e-84a7-93b8288fb0df roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87492024-11-14T04:54:11.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd8e2c03-8f8f-4a1e-84a7-93b8288fb0df resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87502024-11-14T04:54:11.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd8e2c03-8f8f-4a1e-84a7-93b8288fb0df response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87512024-11-14T04:54:12.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8e93e657-0d16-4887-920d-daf4350c918e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87522024-11-14T04:54:12.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8e93e657-0d16-4887-920d-daf4350c918e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87532024-11-14T04:54:12.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8e93e657-0d16-4887-920d-daf4350c918e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87542024-11-14T04:54:13.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ddcd5c32-200c-4200-a315-ace467bb299e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87552024-11-14T04:54:13.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ddcd5c32-200c-4200-a315-ace467bb299e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87562024-11-14T04:54:13.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ddcd5c32-200c-4200-a315-ace467bb299e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87572024-11-14T04:54:14.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b01e886a-9f37-4f73-b6b5-c4f297484526 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87582024-11-14T04:54:14.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b01e886a-9f37-4f73-b6b5-c4f297484526 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87592024-11-14T04:54:14.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b01e886a-9f37-4f73-b6b5-c4f297484526 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87602024-11-14T04:54:15.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6567a143-b023-4b73-bc44-6c7f27412798 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87612024-11-14T04:54:15.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6567a143-b023-4b73-bc44-6c7f27412798 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87622024-11-14T04:54:15.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6567a143-b023-4b73-bc44-6c7f27412798 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
87632024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
87642024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
87652024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
87662024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87672024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87682024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87692024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
87702024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
87712024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87722024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
87732024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87742024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
87752024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
87762024-11-14T04:54:15.307ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
87772024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87782024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.01\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
87792024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
87802024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
87812024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87822024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
87832024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87842024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87852024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
87862024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87872024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
87882024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
87892024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87902024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87912024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
87922024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
87932024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
87942024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87952024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
87962024-11-14T04:54:15.307ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:44:15.307727335 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87972024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87982024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
87992024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88002024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
88012024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
88022024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
88032024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88042024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
88052024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88062024-11-14T04:54:15.307ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
88072024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88082024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
88092024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
88102024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
88112024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88122024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88132024-11-14T04:54:15.307ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
88142024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88152024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
88162024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88172024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
88182024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88192024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
88202024-11-14T04:54:15.308ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88212024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88222024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
88232024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88242024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88252024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88262024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88272024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88282024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88292024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88302024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88312024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88322024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88332024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88342024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88352024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88362024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88372024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88382024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88392024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88402024-11-14T04:54:15.308ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 83625849 } })
88412024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88422024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88432024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88442024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88452024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88462024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88472024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88482024-11-14T04:54:15.308ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 83679621 } })
88492024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88502024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88512024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
88522024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.224706ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
88532024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
88542024-11-14T04:54:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.442262ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
88552024-11-14T04:54:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88562024-11-14T04:54:15.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88572024-11-14T04:54:15.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88582024-11-14T04:54:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.288625ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88592024-11-14T04:54:15.312ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.858071ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
88602024-11-14T04:54:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88612024-11-14T04:54:15.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88622024-11-14T04:54:15.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88632024-11-14T04:54:15.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88642024-11-14T04:54:15.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88652024-11-14T04:54:15.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88662024-11-14T04:54:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88672024-11-14T04:54:15.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88682024-11-14T04:54:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88692024-11-14T04:54:15.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88702024-11-14T04:54:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88712024-11-14T04:54:15.318ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88722024-11-14T04:54:15.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88732024-11-14T04:54:15.321ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 96300727 } })
88742024-11-14T04:54:15.321ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
88752024-11-14T04:54:15.323ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88762024-11-14T04:54:15.324ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 100120467 } })
88772024-11-14T04:54:15.325ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
88782024-11-14T04:54:15.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88792024-11-14T04:54:15.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88802024-11-14T04:54:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88812024-11-14T04:54:15.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88822024-11-14T04:54:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88832024-11-14T04:54:15.330ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:44:15.307727335 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
88842024-11-14T04:54:15.330ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 22.349988ms iteration = 9 status = {"expiration":"2024-11-14T04:44:15.307727335Z","pruned":[]}
88852024-11-14T04:54:15.332ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.86007ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88862024-11-14T04:54:15.332ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88872024-11-14T04:54:15.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88882024-11-14T04:54:15.337ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88892024-11-14T04:54:15.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88902024-11-14T04:54:15.339ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1434, tv_nsec: 114395060 } })
88912024-11-14T04:54:15.339ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
88922024-11-14T04:54:15.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88932024-11-14T04:54:15.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88942024-11-14T04:54:15.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88952024-11-14T04:54:15.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
88962024-11-14T04:54:15.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88972024-11-14T04:54:15.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88982024-11-14T04:54:15.370ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.343775ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
88992024-11-14T04:54:15.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89002024-11-14T04:54:15.383ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89012024-11-14T04:54:15.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89022024-11-14T04:54:15.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89032024-11-14T04:54:15.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89042024-11-14T04:54:15.392ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89052024-11-14T04:54:15.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89062024-11-14T04:54:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89072024-11-14T04:54:15.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89082024-11-14T04:54:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89092024-11-14T04:54:15.400ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89102024-11-14T04:54:15.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89112024-11-14T04:54:15.400ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89122024-11-14T04:54:15.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89132024-11-14T04:54:15.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89142024-11-14T04:54:15.408ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89152024-11-14T04:54:15.408ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89162024-11-14T04:54:15.408ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 100.949744ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89172024-11-14T04:54:15.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89182024-11-14T04:54:15.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89192024-11-14T04:54:15.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89202024-11-14T04:54:15.416ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89212024-11-14T04:54:15.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89222024-11-14T04:54:15.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
89232024-11-14T04:54:15.419ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89242024-11-14T04:54:15.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89252024-11-14T04:54:15.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89262024-11-14T04:54:15.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89272024-11-14T04:54:15.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89282024-11-14T04:54:15.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 126.975077ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
89292024-11-14T04:54:15.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89302024-11-14T04:54:15.438ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89312024-11-14T04:54:15.438ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.354335ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89322024-11-14T04:54:15.438ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
89332024-11-14T04:54:15.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.780217ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
89342024-11-14T04:54:15.439ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89352024-11-14T04:54:15.439ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89362024-11-14T04:54:15.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89372024-11-14T04:54:15.442ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89382024-11-14T04:54:15.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89392024-11-14T04:54:15.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89402024-11-14T04:54:15.447ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89412024-11-14T04:54:15.447ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89422024-11-14T04:54:15.447ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89432024-11-14T04:54:15.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89442024-11-14T04:54:15.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89452024-11-14T04:54:15.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
89462024-11-14T04:54:15.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89472024-11-14T04:54:15.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89482024-11-14T04:54:15.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89492024-11-14T04:54:15.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89502024-11-14T04:54:15.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89512024-11-14T04:54:15.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89522024-11-14T04:54:15.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89532024-11-14T04:54:15.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89542024-11-14T04:54:15.458ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89552024-11-14T04:54:15.458ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89562024-11-14T04:54:15.458ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89572024-11-14T04:54:15.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89582024-11-14T04:54:15.460ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
89592024-11-14T04:54:15.460ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
89602024-11-14T04:54:15.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89612024-11-14T04:54:15.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89622024-11-14T04:54:15.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89632024-11-14T04:54:15.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89642024-11-14T04:54:15.476ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89652024-11-14T04:54:15.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89662024-11-14T04:54:15.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 173.752032ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89672024-11-14T04:54:15.484ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89682024-11-14T04:54:15.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89692024-11-14T04:54:15.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89702024-11-14T04:54:15.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89712024-11-14T04:54:15.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89722024-11-14T04:54:15.506ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89732024-11-14T04:54:15.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89742024-11-14T04:54:15.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 200.661421ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89752024-11-14T04:54:15.520ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
89762024-11-14T04:54:15.520ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
89772024-11-14T04:54:15.520ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
89782024-11-14T04:54:15.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89792024-11-14T04:54:15.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89802024-11-14T04:54:15.521ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
89812024-11-14T04:54:15.521ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89822024-11-14T04:54:15.521ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3ff109e-4ea5-4544-b1ab-ee4dd5c13507", "content-length": "26", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
89832024-11-14T04:54:15.521ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89842024-11-14T04:54:15.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89852024-11-14T04:54:15.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89862024-11-14T04:54:15.523ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
89872024-11-14T04:54:15.523ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
89882024-11-14T04:54:15.523ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 215.999895ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
89892024-11-14T04:54:15.524ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89902024-11-14T04:54:15.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89912024-11-14T04:54:15.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89922024-11-14T04:54:15.528ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89932024-11-14T04:54:15.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89942024-11-14T04:54:15.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89952024-11-14T04:54:15.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89962024-11-14T04:54:15.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89972024-11-14T04:54:15.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89982024-11-14T04:54:15.531ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89992024-11-14T04:54:15.531ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90002024-11-14T04:54:15.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90012024-11-14T04:54:15.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90022024-11-14T04:54:15.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90032024-11-14T04:54:15.532ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90042024-11-14T04:54:15.532ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90052024-11-14T04:54:15.532ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
90062024-11-14T04:54:15.532ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 225.048527ms iteration = 9 status = {"generation":1}
90072024-11-14T04:54:15.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90082024-11-14T04:54:15.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90092024-11-14T04:54:15.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90102024-11-14T04:54:15.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90112024-11-14T04:54:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
90122024-11-14T04:54:15.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90132024-11-14T04:54:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90142024-11-14T04:54:15.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90152024-11-14T04:54:15.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90162024-11-14T04:54:15.559ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 251.41689ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90172024-11-14T04:54:15.567ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
90182024-11-14T04:54:15.567ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
90192024-11-14T04:54:15.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90202024-11-14T04:54:15.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90212024-11-14T04:54:15.569ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
90222024-11-14T04:54:15.569ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 261.285666ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
90232024-11-14T04:54:15.605ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
90242024-11-14T04:54:15.605ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
90252024-11-14T04:54:15.605ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90262024-11-14T04:54:15.605ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25835c74-a16b-4ba6-b0e5-d996286158a7", "content-length": "26", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
90272024-11-14T04:54:15.605ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90282024-11-14T04:54:15.609ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
90292024-11-14T04:54:15.614ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
90302024-11-14T04:54:15.614ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90312024-11-14T04:54:15.614ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "062e6ee5-ffab-497e-bda4-d699e188a030", "content-length": "26", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
90322024-11-14T04:54:15.614ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90332024-11-14T04:54:15.616ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90342024-11-14T04:54:15.676ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 368.385558ms iteration = 19 status = {"physical_disks_added":0}
90352024-11-14T04:54:15.708ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 400.893869ms iteration = 17 status = {}
90362024-11-14T04:54:15.730ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
90372024-11-14T04:54:15.730ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "83ba56c8-e843-4318-8d0a-01f49dfc1e11", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90382024-11-14T04:54:15.730ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90392024-11-14T04:54:15.731ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8301cd41-1edd-411b-9a82-a50ff0fa9729", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90402024-11-14T04:54:15.731ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90412024-11-14T04:54:15.733ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
90422024-11-14T04:54:15.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 426.152501ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90432024-11-14T04:54:15.761ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90442024-11-14T04:54:15.761ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbd76e95-3187-42ca-94d5-4926cbd35202", "content-length": "1", "date": "Thu, 14 Nov 2024 04:54:14 GMT"} })
90452024-11-14T04:54:15.763ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90462024-11-14T04:54:15.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90472024-11-14T04:54:15.801ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90482024-11-14T04:54:15.801ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90492024-11-14T04:54:15.801ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "21600b5e-da64-423d-8d14-455657317c69", "content-length": "372", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
90502024-11-14T04:54:15.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90512024-11-14T04:54:15.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90522024-11-14T04:54:15.804ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 496.993462ms iteration = 17 status = 0
90532024-11-14T04:54:15.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90542024-11-14T04:54:15.806ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 498.456904ms iteration = 17 status = null
90552024-11-14T04:54:15.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90562024-11-14T04:54:15.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90572024-11-14T04:54:15.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90582024-11-14T04:54:15.812ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
90592024-11-14T04:54:15.812ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
90602024-11-14T04:54:15.812ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
90612024-11-14T04:54:15.813ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 505.303703ms iteration = 9 status = {"generation":2}
90622024-11-14T04:54:15.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90632024-11-14T04:54:15.838ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
90642024-11-14T04:54:15.838ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 530.77653ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
90652024-11-14T04:54:15.842ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90662024-11-14T04:54:15.842ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90672024-11-14T04:54:15.842ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 534.486227ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90682024-11-14T04:54:15.856ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90692024-11-14T04:54:15.856ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90702024-11-14T04:54:15.889ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
90712024-11-14T04:54:15.889ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "edc8d272-25dc-427a-acd1-4660496cdcb6", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
90722024-11-14T04:54:15.890ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
90732024-11-14T04:54:15.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90742024-11-14T04:54:15.892ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ff978983-4435-4806-9407-5729a3144efa", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
90752024-11-14T04:54:15.892ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
90762024-11-14T04:54:15.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90772024-11-14T04:54:15.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fad583fe-2468-4b67-8958-e68f573b2c01", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
90782024-11-14T04:54:15.893ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
90792024-11-14T04:54:15.894ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
90802024-11-14T04:54:15.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90812024-11-14T04:54:15.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90822024-11-14T04:54:15.895ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
90832024-11-14T04:54:15.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 587.961877ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
90842024-11-14T04:54:15.905ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90852024-11-14T04:54:15.906ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ac62132-ba56-4050-b954-72f6ad2b23c9", "content-length": "134", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
90862024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90872024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
90882024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90892024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90902024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90912024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90922024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90932024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90942024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90952024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90962024-11-14T04:54:15.906ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
90972024-11-14T04:54:15.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90982024-11-14T04:54:15.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90992024-11-14T04:54:15.908ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91002024-11-14T04:54:15.908ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "30319d24-6e93-4889-9549-65c167038abc", "content-length": "2", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
91012024-11-14T04:54:15.909ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91022024-11-14T04:54:15.909ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c393fc39-384c-4c01-be6d-b9def5c2a227", "content-length": "51", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
91032024-11-14T04:54:15.909ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
91042024-11-14T04:54:15.909ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91052024-11-14T04:54:15.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91062024-11-14T04:54:15.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91072024-11-14T04:54:15.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91082024-11-14T04:54:15.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91092024-11-14T04:54:15.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91102024-11-14T04:54:15.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91112024-11-14T04:54:15.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91122024-11-14T04:54:15.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91132024-11-14T04:54:15.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91142024-11-14T04:54:15.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91152024-11-14T04:54:15.941ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "def6d9fc-b1cf-41f6-aa5a-370db3963415", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
91162024-11-14T04:54:15.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91172024-11-14T04:54:15.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91182024-11-14T04:54:15.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91192024-11-14T04:54:15.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91202024-11-14T04:54:15.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91212024-11-14T04:54:15.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91222024-11-14T04:54:15.951ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91232024-11-14T04:54:15.951ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91242024-11-14T04:54:15.951ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "35d29eb2-ebea-411e-be6c-36e8e3a3ff38", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
91252024-11-14T04:54:15.952ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 644.883724ms iteration = 17 status = {}
91262024-11-14T04:54:16.007ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91272024-11-14T04:54:16.009ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3af965c4-c5de-46de-afc8-4462a479630c", "content-length": "691", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
91282024-11-14T04:54:16.009ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
91292024-11-14T04:54:16.009ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91302024-11-14T04:54:16.009ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
91312024-11-14T04:54:16.010ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 702.74035ms iteration = 17 status = {}
91322024-11-14T04:54:16.039ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b7dd865c-deee-4401-84a1-2ec2fbee9329", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
91332024-11-14T04:54:16.039ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
91342024-11-14T04:54:16.039ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91352024-11-14T04:54:16.043ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "93cfb758-ba7c-4846-a162-d92fdb520bd8", "content-length": "682", "date": "Thu, 14 Nov 2024 04:54:15 GMT"} })
91362024-11-14T04:54:16.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91372024-11-14T04:54:16.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91382024-11-14T04:54:16.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91392024-11-14T04:54:16.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91402024-11-14T04:54:16.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91412024-11-14T04:54:16.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91422024-11-14T04:54:16.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91432024-11-14T04:54:16.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91442024-11-14T04:54:16.060ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 752.854401ms iteration = 17 status = {}
91452024-11-14T04:54:16.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c885f284-8bb1-40d3-841d-1362137c5bbf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91462024-11-14T04:54:16.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c885f284-8bb1-40d3-841d-1362137c5bbf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91472024-11-14T04:54:16.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c885f284-8bb1-40d3-841d-1362137c5bbf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91482024-11-14T04:54:16.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 5be50be2-5658-49bf-a983-1a9bd35ac74b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91492024-11-14T04:54:16.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 5be50be2-5658-49bf-a983-1a9bd35ac74b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91502024-11-14T04:54:16.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 5be50be2-5658-49bf-a983-1a9bd35ac74b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
91512024-11-14T04:54:17.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89fe7139-0c94-489f-a3ae-bd78d20f1461 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91522024-11-14T04:54:17.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89fe7139-0c94-489f-a3ae-bd78d20f1461 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91532024-11-14T04:54:17.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 89fe7139-0c94-489f-a3ae-bd78d20f1461 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91542024-11-14T04:54:18.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0858bf2a-f17b-4c94-864d-c3a063cbfe7c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91552024-11-14T04:54:18.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0858bf2a-f17b-4c94-864d-c3a063cbfe7c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91562024-11-14T04:54:18.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0858bf2a-f17b-4c94-864d-c3a063cbfe7c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91572024-11-14T04:54:19.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 458f3d17-acff-4f52-b002-ef1f67fe5419 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91582024-11-14T04:54:19.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 458f3d17-acff-4f52-b002-ef1f67fe5419 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91592024-11-14T04:54:19.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 458f3d17-acff-4f52-b002-ef1f67fe5419 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91602024-11-14T04:54:20.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe864504-5b26-455d-a787-1b6b9cbb617a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91612024-11-14T04:54:20.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe864504-5b26-455d-a787-1b6b9cbb617a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91622024-11-14T04:54:20.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fe864504-5b26-455d-a787-1b6b9cbb617a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91632024-11-14T04:54:20.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 534 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 89e58505-87ee-463c-a4bf-a05adef54d44 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
91642024-11-14T04:54:21.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f08b279b-ed8d-45b4-a16b-53d245c4bcce roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91652024-11-14T04:54:21.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f08b279b-ed8d-45b4-a16b-53d245c4bcce resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91662024-11-14T04:54:21.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f08b279b-ed8d-45b4-a16b-53d245c4bcce response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91672024-11-14T04:54:22.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 64cc8ee5-5918-48d7-b9c3-874a341cdd1e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91682024-11-14T04:54:22.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 64cc8ee5-5918-48d7-b9c3-874a341cdd1e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91692024-11-14T04:54:22.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 64cc8ee5-5918-48d7-b9c3-874a341cdd1e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91702024-11-14T04:54:23.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d0184bdc-16a6-498d-a35b-0e8c1146e021 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91712024-11-14T04:54:23.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d0184bdc-16a6-498d-a35b-0e8c1146e021 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91722024-11-14T04:54:23.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d0184bdc-16a6-498d-a35b-0e8c1146e021 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91732024-11-14T04:54:24.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a99a874f-ca6a-4c14-8ce0-86bdff45782d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91742024-11-14T04:54:24.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a99a874f-ca6a-4c14-8ce0-86bdff45782d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91752024-11-14T04:54:24.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a99a874f-ca6a-4c14-8ce0-86bdff45782d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91762024-11-14T04:54:25.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
91772024-11-14T04:54:25.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
91782024-11-14T04:54:25.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91792024-11-14T04:54:25.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91802024-11-14T04:54:25.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91812024-11-14T04:54:25.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91822024-11-14T04:54:25.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91832024-11-14T04:54:25.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91842024-11-14T04:54:25.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91852024-11-14T04:54:25.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91862024-11-14T04:54:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91872024-11-14T04:54:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91882024-11-14T04:54:25.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91892024-11-14T04:54:25.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
91902024-11-14T04:54:25.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91912024-11-14T04:54:25.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91922024-11-14T04:54:25.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
91932024-11-14T04:54:25.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.784179ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
91942024-11-14T04:54:25.339ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91952024-11-14T04:54:25.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91962024-11-14T04:54:25.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8d22eb8f-71aa-42d5-8391-48c404f7631b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91972024-11-14T04:54:25.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8d22eb8f-71aa-42d5-8391-48c404f7631b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91982024-11-14T04:54:25.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8d22eb8f-71aa-42d5-8391-48c404f7631b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
91992024-11-14T04:54:25.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.571849ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92002024-11-14T04:54:26.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fd0bb40-7fd0-4957-81df-b3825d3d0daf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92012024-11-14T04:54:26.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fd0bb40-7fd0-4957-81df-b3825d3d0daf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92022024-11-14T04:54:26.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fd0bb40-7fd0-4957-81df-b3825d3d0daf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92032024-11-14T04:54:27.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b7b68979-6a6a-46d2-a6e2-04ed1ba41b27 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92042024-11-14T04:54:27.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b7b68979-6a6a-46d2-a6e2-04ed1ba41b27 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92052024-11-14T04:54:27.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b7b68979-6a6a-46d2-a6e2-04ed1ba41b27 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92062024-11-14T04:54:28.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4fde1bb5-a5e5-482e-86dd-673e24659d18 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92072024-11-14T04:54:28.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4fde1bb5-a5e5-482e-86dd-673e24659d18 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92082024-11-14T04:54:28.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4fde1bb5-a5e5-482e-86dd-673e24659d18 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92092024-11-14T04:54:29.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e37afd3-2d56-4933-98e1-d695587bc196 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92102024-11-14T04:54:29.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e37afd3-2d56-4933-98e1-d695587bc196 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92112024-11-14T04:54:29.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e37afd3-2d56-4933-98e1-d695587bc196 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92122024-11-14T04:54:30.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7743a81-8a3c-4ffd-af65-79feecf64798 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92132024-11-14T04:54:30.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7743a81-8a3c-4ffd-af65-79feecf64798 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92142024-11-14T04:54:30.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7743a81-8a3c-4ffd-af65-79feecf64798 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92152024-11-14T04:54:31.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 35e8f4ad-c56e-4ec2-a56b-19f78ac457a1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92162024-11-14T04:54:31.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 35e8f4ad-c56e-4ec2-a56b-19f78ac457a1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92172024-11-14T04:54:31.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 35e8f4ad-c56e-4ec2-a56b-19f78ac457a1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92182024-11-14T04:54:32.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 549608c8-1c6a-4fa7-acbd-f8a7923bbf99 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92192024-11-14T04:54:32.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 549608c8-1c6a-4fa7-acbd-f8a7923bbf99 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92202024-11-14T04:54:32.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 549608c8-1c6a-4fa7-acbd-f8a7923bbf99 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92212024-11-14T04:54:33.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 930f50e1-8c13-4aab-9aaa-74ec137c8af7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92222024-11-14T04:54:33.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 930f50e1-8c13-4aab-9aaa-74ec137c8af7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92232024-11-14T04:54:33.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 930f50e1-8c13-4aab-9aaa-74ec137c8af7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92242024-11-14T04:54:34.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51c9feb2-a26d-4fb7-ac11-94f22dee145d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92252024-11-14T04:54:34.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51c9feb2-a26d-4fb7-ac11-94f22dee145d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92262024-11-14T04:54:34.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 51c9feb2-a26d-4fb7-ac11-94f22dee145d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92272024-11-14T04:54:35.258ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 842 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 9090d809-e516-407c-8301-3245aafede3a response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
92282024-11-14T04:54:35.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
92292024-11-14T04:54:35.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92302024-11-14T04:54:35.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
92312024-11-14T04:54:35.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92322024-11-14T04:54:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92332024-11-14T04:54:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92342024-11-14T04:54:35.309ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92352024-11-14T04:54:35.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92362024-11-14T04:54:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92372024-11-14T04:54:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92382024-11-14T04:54:35.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92392024-11-14T04:54:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92402024-11-14T04:54:35.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92412024-11-14T04:54:35.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92422024-11-14T04:54:35.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92432024-11-14T04:54:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
92442024-11-14T04:54:35.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92452024-11-14T04:54:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92462024-11-14T04:54:35.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
92472024-11-14T04:54:35.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.241793ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
92482024-11-14T04:54:35.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.478584ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92492024-11-14T04:54:35.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07f81bf4-60d6-4121-aabf-8ee7bdd3f2cf roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92502024-11-14T04:54:35.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07f81bf4-60d6-4121-aabf-8ee7bdd3f2cf resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92512024-11-14T04:54:35.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07f81bf4-60d6-4121-aabf-8ee7bdd3f2cf response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92522024-11-14T04:54:36.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e8d8015-9aab-4cbb-9778-65c12a34272f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92532024-11-14T04:54:36.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e8d8015-9aab-4cbb-9778-65c12a34272f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92542024-11-14T04:54:36.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e8d8015-9aab-4cbb-9778-65c12a34272f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92552024-11-14T04:54:37.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4d4b4a18-cde6-4e2d-8642-25cb12673a5c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92562024-11-14T04:54:37.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4d4b4a18-cde6-4e2d-8642-25cb12673a5c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92572024-11-14T04:54:37.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4d4b4a18-cde6-4e2d-8642-25cb12673a5c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92582024-11-14T04:54:38.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8e77246c-09ee-4ad3-96af-cd5a075065e8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92592024-11-14T04:54:38.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8e77246c-09ee-4ad3-96af-cd5a075065e8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92602024-11-14T04:54:38.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8e77246c-09ee-4ad3-96af-cd5a075065e8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92612024-11-14T04:54:39.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69ee4ac3-1582-4709-a54c-bcdb782ba92b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92622024-11-14T04:54:39.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69ee4ac3-1582-4709-a54c-bcdb782ba92b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92632024-11-14T04:54:39.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69ee4ac3-1582-4709-a54c-bcdb782ba92b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92642024-11-14T04:54:40.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 59057fa8-9f12-4ca9-9513-3c2d602e17e6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92652024-11-14T04:54:40.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 59057fa8-9f12-4ca9-9513-3c2d602e17e6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92662024-11-14T04:54:40.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 59057fa8-9f12-4ca9-9513-3c2d602e17e6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92672024-11-14T04:54:41.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41918e25-9140-43fc-94fc-d328a9c0b6e1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92682024-11-14T04:54:41.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41918e25-9140-43fc-94fc-d328a9c0b6e1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92692024-11-14T04:54:41.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41918e25-9140-43fc-94fc-d328a9c0b6e1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92702024-11-14T04:54:42.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0fa48e2c-5d3c-429d-9c44-0145b20cd3c9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92712024-11-14T04:54:42.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0fa48e2c-5d3c-429d-9c44-0145b20cd3c9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92722024-11-14T04:54:42.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0fa48e2c-5d3c-429d-9c44-0145b20cd3c9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92732024-11-14T04:54:43.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1a07ca9c-736c-4af5-b6e7-3af9bbf2bdb0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92742024-11-14T04:54:43.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1a07ca9c-736c-4af5-b6e7-3af9bbf2bdb0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92752024-11-14T04:54:43.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1a07ca9c-736c-4af5-b6e7-3af9bbf2bdb0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92762024-11-14T04:54:44.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33148e2d-81d3-47a7-ac25-350bae597062 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92772024-11-14T04:54:44.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33148e2d-81d3-47a7-ac25-350bae597062 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92782024-11-14T04:54:44.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33148e2d-81d3-47a7-ac25-350bae597062 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
92792024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
92802024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92812024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
92822024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
92832024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92842024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
92852024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92862024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
92872024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
92882024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92892024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
92902024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92912024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92922024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
92932024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
92942024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92952024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92962024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
92972024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92982024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
92992024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93002024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
93012024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93022024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93032024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
93042024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
93052024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93062024-11-14T04:54:45.307ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93072024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
93082024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93092024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93102024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
93112024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93122024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
93132024-11-14T04:54:45.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93142024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93152024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93162024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93172024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93182024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93192024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93202024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93212024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93222024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93232024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93242024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93252024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93262024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93272024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93282024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93292024-11-14T04:54:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93302024-11-14T04:54:45.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93312024-11-14T04:54:45.311ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.588104ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93322024-11-14T04:54:45.311ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 87480539 } })
93332024-11-14T04:54:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93342024-11-14T04:54:45.312ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93352024-11-14T04:54:45.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93362024-11-14T04:54:45.312ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
93372024-11-14T04:54:45.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93382024-11-14T04:54:45.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93392024-11-14T04:54:45.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93402024-11-14T04:54:45.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93412024-11-14T04:54:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93422024-11-14T04:54:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93432024-11-14T04:54:45.325ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93442024-11-14T04:54:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93452024-11-14T04:54:45.330ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 106395737 } })
93462024-11-14T04:54:45.331ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
93472024-11-14T04:54:45.335ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93482024-11-14T04:54:45.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93492024-11-14T04:54:45.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93502024-11-14T04:54:45.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93512024-11-14T04:54:45.340ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93522024-11-14T04:54:45.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93532024-11-14T04:54:45.344ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93542024-11-14T04:54:45.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93552024-11-14T04:54:45.368ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
93562024-11-14T04:54:45.368ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93572024-11-14T04:54:45.371ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d473e209-9fc8-4142-9c3c-1d0c252ac2b7", "content-length": "26", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
93582024-11-14T04:54:45.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93592024-11-14T04:54:45.374ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93602024-11-14T04:54:45.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93612024-11-14T04:54:45.379ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93622024-11-14T04:54:45.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.427388ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
93632024-11-14T04:54:45.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93642024-11-14T04:54:45.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93652024-11-14T04:54:45.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93662024-11-14T04:54:45.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93672024-11-14T04:54:45.382ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93682024-11-14T04:54:45.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93692024-11-14T04:54:45.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93702024-11-14T04:54:45.388ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93712024-11-14T04:54:45.388ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93722024-11-14T04:54:45.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93732024-11-14T04:54:45.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93742024-11-14T04:54:45.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93752024-11-14T04:54:45.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93762024-11-14T04:54:45.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93772024-11-14T04:54:45.390ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.382065ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93782024-11-14T04:54:45.392ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 84.725323ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
93792024-11-14T04:54:45.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93802024-11-14T04:54:45.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93812024-11-14T04:54:45.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93822024-11-14T04:54:45.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93832024-11-14T04:54:45.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93842024-11-14T04:54:45.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93852024-11-14T04:54:45.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93862024-11-14T04:54:45.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93872024-11-14T04:54:45.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93882024-11-14T04:54:45.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93892024-11-14T04:54:45.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93902024-11-14T04:54:45.400ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93912024-11-14T04:54:45.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93922024-11-14T04:54:45.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
93932024-11-14T04:54:45.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93942024-11-14T04:54:45.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93952024-11-14T04:54:45.403ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93962024-11-14T04:54:45.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93972024-11-14T04:54:45.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93982024-11-14T04:54:45.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93992024-11-14T04:54:45.407ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1464, tv_nsec: 182509841 } })
94002024-11-14T04:54:45.407ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94012024-11-14T04:54:45.407ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
94022024-11-14T04:54:45.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94032024-11-14T04:54:45.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.794129ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94042024-11-14T04:54:45.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94052024-11-14T04:54:45.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94062024-11-14T04:54:45.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94072024-11-14T04:54:45.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
94082024-11-14T04:54:45.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94092024-11-14T04:54:45.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94102024-11-14T04:54:45.419ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.20926ms iteration = 20 status = {"physical_disks_added":0}
94112024-11-14T04:54:45.421ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 113.756064ms iteration = 18 status = 0
94122024-11-14T04:54:45.425ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
94132024-11-14T04:54:45.425ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.235904ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
94142024-11-14T04:54:45.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.603506ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94152024-11-14T04:54:45.455ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 147.732318ms iteration = 18 status = {}
94162024-11-14T04:54:45.455ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94172024-11-14T04:54:45.455ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94182024-11-14T04:54:45.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94192024-11-14T04:54:45.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94202024-11-14T04:54:45.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 150.727955ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
94212024-11-14T04:54:45.460ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
94222024-11-14T04:54:45.460ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 153.090663ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94232024-11-14T04:54:45.463ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
94242024-11-14T04:54:45.463ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94252024-11-14T04:54:45.463ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85e9dca7-1bb1-4dc9-936a-c440da48e495", "content-length": "26", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94262024-11-14T04:54:45.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94272024-11-14T04:54:45.465ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94282024-11-14T04:54:45.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94292024-11-14T04:54:45.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94302024-11-14T04:54:45.496ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94312024-11-14T04:54:45.496ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94322024-11-14T04:54:45.496ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 189.189559ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94332024-11-14T04:54:45.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
94342024-11-14T04:54:45.541ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94352024-11-14T04:54:45.542ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6270fb7a-b8cd-4a77-99c9-c7880cf93340", "content-length": "26", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94362024-11-14T04:54:45.542ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94372024-11-14T04:54:45.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
94382024-11-14T04:54:45.576ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94392024-11-14T04:54:45.576ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94402024-11-14T04:54:45.577ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "88bbea0d-c7ba-4fc8-86cb-82289a9b1114", "content-length": "372", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94412024-11-14T04:54:45.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94422024-11-14T04:54:45.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94432024-11-14T04:54:45.578ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94442024-11-14T04:54:45.579ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "01a0056d-bb36-44fc-a5ad-addb26aacde3", "content-length": "1", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94452024-11-14T04:54:45.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94462024-11-14T04:54:45.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94472024-11-14T04:54:45.585ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 277.761324ms iteration = 18 status = null
94482024-11-14T04:54:45.595ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94492024-11-14T04:54:45.595ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94502024-11-14T04:54:45.596ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c56c0764-e185-4ff2-aab4-d16f22d9b729", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94512024-11-14T04:54:45.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94522024-11-14T04:54:45.596ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94532024-11-14T04:54:45.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94542024-11-14T04:54:45.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94552024-11-14T04:54:45.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94562024-11-14T04:54:45.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94572024-11-14T04:54:45.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94582024-11-14T04:54:45.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94592024-11-14T04:54:45.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94602024-11-14T04:54:45.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94612024-11-14T04:54:45.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94622024-11-14T04:54:45.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94632024-11-14T04:54:45.604ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94642024-11-14T04:54:45.604ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94652024-11-14T04:54:45.605ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9662364e-2f75-497a-8585-1976cf4e5272", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94662024-11-14T04:54:45.606ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 299.162864ms iteration = 18 status = {}
94672024-11-14T04:54:45.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94682024-11-14T04:54:45.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94692024-11-14T04:54:45.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94702024-11-14T04:54:45.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94712024-11-14T04:54:45.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94722024-11-14T04:54:45.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94732024-11-14T04:54:45.674ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
94742024-11-14T04:54:45.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94752024-11-14T04:54:45.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94762024-11-14T04:54:45.684ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94772024-11-14T04:54:45.685ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc6983d3-ff9b-4ff3-8d23-702b475c4495", "content-length": "134", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94782024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94792024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
94802024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94812024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94822024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94832024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94842024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94852024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94862024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94872024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94882024-11-14T04:54:45.685ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
94892024-11-14T04:54:45.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94902024-11-14T04:54:45.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94912024-11-14T04:54:45.687ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94922024-11-14T04:54:45.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "de67e019-de89-4cfd-bf58-70ebfde8817c", "content-length": "2", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94932024-11-14T04:54:45.688ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94942024-11-14T04:54:45.688ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9e9f43e-afa5-447d-a7d2-031745b7fdcf", "content-length": "51", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94952024-11-14T04:54:45.688ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
94962024-11-14T04:54:45.688ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94972024-11-14T04:54:45.689ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94982024-11-14T04:54:45.694ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fef563f-5451-4163-8624-3cfdf4aae9e1", "content-length": "691", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
94992024-11-14T04:54:45.695ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
95002024-11-14T04:54:45.695ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95012024-11-14T04:54:45.695ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95022024-11-14T04:54:45.696ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.961054ms iteration = 18 status = {}
95032024-11-14T04:54:45.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 087544ce-4c09-4c0e-9b73-bb3214d34c2f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
95042024-11-14T04:54:45.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 087544ce-4c09-4c0e-9b73-bb3214d34c2f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
95052024-11-14T04:54:45.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2741 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 087544ce-4c09-4c0e-9b73-bb3214d34c2f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
95062024-11-14T04:54:45.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04ec0172-44a4-4fdb-a30b-5d78d01fc16c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95072024-11-14T04:54:45.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04ec0172-44a4-4fdb-a30b-5d78d01fc16c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95082024-11-14T04:54:45.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04ec0172-44a4-4fdb-a30b-5d78d01fc16c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95092024-11-14T04:54:45.888ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4f0fed12-c11d-434e-9a6d-1fcc58e174d4", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
95102024-11-14T04:54:45.888ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
95112024-11-14T04:54:45.888ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95122024-11-14T04:54:45.893ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "57735447-b9fa-4f7f-8652-c0a99a322993", "content-length": "682", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
95132024-11-14T04:54:45.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95142024-11-14T04:54:45.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95152024-11-14T04:54:45.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95162024-11-14T04:54:45.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95172024-11-14T04:54:45.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95182024-11-14T04:54:45.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95192024-11-14T04:54:45.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95202024-11-14T04:54:45.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95212024-11-14T04:54:45.910ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 602.718883ms iteration = 18 status = {}
95222024-11-14T04:54:46.000ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
95232024-11-14T04:54:46.000ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
95242024-11-14T04:54:46.030ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
95252024-11-14T04:54:46.030ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:61750
95262024-11-14T04:54:46.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61750 req_id = bde4c8e9-e812-49e1-aefa-e73a9db6ae46 roles = RoleSet { roles: {} } uri = /metrics/producers
95272024-11-14T04:54:46.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61750 req_id = bde4c8e9-e812-49e1-aefa-e73a9db6ae46 resource = Database result = Ok(()) uri = /metrics/producers
95282024-11-14T04:54:46.066ZINFOnexus: assigned collector to new producer collector_id = 459b411b-9021-43ae-8875-254e55794157 file = nexus/src/app/oximeter.rs:76 producer_id = 79994e02-6747-4071-83af-7872b31640fb
95292024-11-14T04:54:46.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35533 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61750 req_id = bde4c8e9-e812-49e1-aefa-e73a9db6ae46 response_code = 201 uri = /metrics/producers
95302024-11-14T04:54:46.066ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bde4c8e9-e812-49e1-aefa-e73a9db6ae46", "content-length": "41", "date": "Thu, 14 Nov 2024 04:54:45 GMT"} })
95312024-11-14T04:54:46.068ZDEBGnexus (producer-registration-task): registered with nexus successfully
95322024-11-14T04:54:46.068ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
95332024-11-14T04:54:46.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8bc66e26-06f2-4c4b-a322-461f308ede5c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95342024-11-14T04:54:46.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8bc66e26-06f2-4c4b-a322-461f308ede5c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95352024-11-14T04:54:46.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8bc66e26-06f2-4c4b-a322-461f308ede5c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95362024-11-14T04:54:47.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a31efc6-1353-439b-be32-281a38fb7a5c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95372024-11-14T04:54:47.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a31efc6-1353-439b-be32-281a38fb7a5c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95382024-11-14T04:54:47.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a31efc6-1353-439b-be32-281a38fb7a5c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95392024-11-14T04:54:48.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 508a6915-0adc-4790-a42a-67d436efdf38 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95402024-11-14T04:54:48.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 508a6915-0adc-4790-a42a-67d436efdf38 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95412024-11-14T04:54:48.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 508a6915-0adc-4790-a42a-67d436efdf38 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95422024-11-14T04:54:49.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9aa876d1-a3b9-4108-9e28-a5d9f53d9a3a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95432024-11-14T04:54:49.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9aa876d1-a3b9-4108-9e28-a5d9f53d9a3a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95442024-11-14T04:54:49.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9aa876d1-a3b9-4108-9e28-a5d9f53d9a3a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95452024-11-14T04:54:50.259ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 583 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 51a0e114-c8fe-4709-a541-b066516405b0 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
95462024-11-14T04:54:50.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56174662-b56a-409c-b07f-1160f4b4a550 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95472024-11-14T04:54:50.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56174662-b56a-409c-b07f-1160f4b4a550 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95482024-11-14T04:54:50.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56174662-b56a-409c-b07f-1160f4b4a550 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95492024-11-14T04:54:51.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5cb9c4c-618b-463b-ae77-3433b5b70790 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95502024-11-14T04:54:51.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5cb9c4c-618b-463b-ae77-3433b5b70790 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95512024-11-14T04:54:51.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5cb9c4c-618b-463b-ae77-3433b5b70790 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95522024-11-14T04:54:52.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75dfdf98-dc72-4b35-9ed6-2279f93dd058 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95532024-11-14T04:54:52.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75dfdf98-dc72-4b35-9ed6-2279f93dd058 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95542024-11-14T04:54:52.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75dfdf98-dc72-4b35-9ed6-2279f93dd058 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95552024-11-14T04:54:53.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a0347497-b7b9-45e1-a84e-68eabfdd0c71 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95562024-11-14T04:54:53.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a0347497-b7b9-45e1-a84e-68eabfdd0c71 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95572024-11-14T04:54:53.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a0347497-b7b9-45e1-a84e-68eabfdd0c71 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95582024-11-14T04:54:55.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6e54e41-0195-4242-9823-5ab6d6d0ab6f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95592024-11-14T04:54:55.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6e54e41-0195-4242-9823-5ab6d6d0ab6f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95602024-11-14T04:54:55.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6e54e41-0195-4242-9823-5ab6d6d0ab6f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95612024-11-14T04:54:55.250ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:49358
95622024-11-14T04:54:55.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 99fab97c-6973-4890-84b1-9c3fde1914ad roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
95632024-11-14T04:54:55.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 99fab97c-6973-4890-84b1-9c3fde1914ad resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
95642024-11-14T04:54:55.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 99fab97c-6973-4890-84b1-9c3fde1914ad response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
95652024-11-14T04:54:55.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 752c7433-45d0-450e-a501-3880c821253c roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
95662024-11-14T04:54:55.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 752c7433-45d0-450e-a501-3880c821253c resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
95672024-11-14T04:54:55.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 752c7433-45d0-450e-a501-3880c821253c response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
95682024-11-14T04:54:55.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
95692024-11-14T04:54:55.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
95702024-11-14T04:54:55.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95712024-11-14T04:54:55.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95722024-11-14T04:54:55.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95732024-11-14T04:54:55.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95742024-11-14T04:54:55.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95752024-11-14T04:54:55.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95762024-11-14T04:54:55.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95772024-11-14T04:54:55.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95782024-11-14T04:54:55.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95792024-11-14T04:54:55.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95802024-11-14T04:54:55.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95812024-11-14T04:54:55.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
95822024-11-14T04:54:55.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95832024-11-14T04:54:55.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95842024-11-14T04:54:55.334ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
95852024-11-14T04:54:55.334ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.623869ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
95862024-11-14T04:54:55.342ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95872024-11-14T04:54:55.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95882024-11-14T04:54:55.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.560957ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95892024-11-14T04:54:56.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 554e409c-743e-488c-8a90-e6200ea67a86 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95902024-11-14T04:54:56.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 554e409c-743e-488c-8a90-e6200ea67a86 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95912024-11-14T04:54:56.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 554e409c-743e-488c-8a90-e6200ea67a86 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95922024-11-14T04:54:57.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c5ae65fd-aef3-498d-bc6f-0af937114b94 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95932024-11-14T04:54:57.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c5ae65fd-aef3-498d-bc6f-0af937114b94 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95942024-11-14T04:54:57.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c5ae65fd-aef3-498d-bc6f-0af937114b94 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95952024-11-14T04:54:58.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0821d2de-b9e3-46a3-b295-27182e8a1322 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95962024-11-14T04:54:58.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0821d2de-b9e3-46a3-b295-27182e8a1322 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95972024-11-14T04:54:58.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0821d2de-b9e3-46a3-b295-27182e8a1322 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95982024-11-14T04:54:59.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d31d7089-d998-4081-9852-6f2a61adc37c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
95992024-11-14T04:54:59.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d31d7089-d998-4081-9852-6f2a61adc37c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96002024-11-14T04:54:59.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d31d7089-d998-4081-9852-6f2a61adc37c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96012024-11-14T04:55:00.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2e7b9d96-a07a-44ba-a41e-021bd0d193d3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96022024-11-14T04:55:00.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2e7b9d96-a07a-44ba-a41e-021bd0d193d3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96032024-11-14T04:55:00.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2e7b9d96-a07a-44ba-a41e-021bd0d193d3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96042024-11-14T04:55:01.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13fd56cb-7823-4e5c-90d3-8bd0e53cc4c6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96052024-11-14T04:55:01.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13fd56cb-7823-4e5c-90d3-8bd0e53cc4c6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96062024-11-14T04:55:01.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13fd56cb-7823-4e5c-90d3-8bd0e53cc4c6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96072024-11-14T04:55:02.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 43df8993-b504-4ffd-892e-086fb088815e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96082024-11-14T04:55:02.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 43df8993-b504-4ffd-892e-086fb088815e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96092024-11-14T04:55:02.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 43df8993-b504-4ffd-892e-086fb088815e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96102024-11-14T04:55:03.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ea35842-d13d-471f-8136-dcde1ea3f7bc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96112024-11-14T04:55:03.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ea35842-d13d-471f-8136-dcde1ea3f7bc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96122024-11-14T04:55:03.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ea35842-d13d-471f-8136-dcde1ea3f7bc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96132024-11-14T04:55:04.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0aae6f35-4159-4e8b-8e72-5b0a34269405 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96142024-11-14T04:55:04.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0aae6f35-4159-4e8b-8e72-5b0a34269405 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96152024-11-14T04:55:04.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0aae6f35-4159-4e8b-8e72-5b0a34269405 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96162024-11-14T04:55:05.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b2a54cc6-87e8-4368-a00d-df9cde693191 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96172024-11-14T04:55:05.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b2a54cc6-87e8-4368-a00d-df9cde693191 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96182024-11-14T04:55:05.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b2a54cc6-87e8-4368-a00d-df9cde693191 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96192024-11-14T04:55:05.258ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1020 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 518f5638-5d7b-4284-8ccd-be24036fd1cd response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
96202024-11-14T04:55:05.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
96212024-11-14T04:55:05.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
96222024-11-14T04:55:05.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96232024-11-14T04:55:05.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96242024-11-14T04:55:05.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96252024-11-14T04:55:05.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96262024-11-14T04:55:05.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96272024-11-14T04:55:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96282024-11-14T04:55:05.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96292024-11-14T04:55:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96302024-11-14T04:55:05.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96312024-11-14T04:55:05.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96322024-11-14T04:55:05.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96332024-11-14T04:55:05.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
96342024-11-14T04:55:05.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96352024-11-14T04:55:05.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96362024-11-14T04:55:05.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
96372024-11-14T04:55:05.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.318846ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
96382024-11-14T04:55:05.336ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96392024-11-14T04:55:05.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96402024-11-14T04:55:05.338ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.381168ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96412024-11-14T04:55:06.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fb36424c-bebd-435e-a91f-7fbe2990be2b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96422024-11-14T04:55:06.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fb36424c-bebd-435e-a91f-7fbe2990be2b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96432024-11-14T04:55:06.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fb36424c-bebd-435e-a91f-7fbe2990be2b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96442024-11-14T04:55:07.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5646188e-8320-49d2-b4a6-fff13fa7ef87 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96452024-11-14T04:55:07.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5646188e-8320-49d2-b4a6-fff13fa7ef87 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96462024-11-14T04:55:07.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5646188e-8320-49d2-b4a6-fff13fa7ef87 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96472024-11-14T04:55:08.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0dc337f-dc79-489b-a67e-13d0a7c33780 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96482024-11-14T04:55:08.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0dc337f-dc79-489b-a67e-13d0a7c33780 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96492024-11-14T04:55:08.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0dc337f-dc79-489b-a67e-13d0a7c33780 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96502024-11-14T04:55:09.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5ab7b898-698a-4a9d-ba3a-2c0218d8ac16 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96512024-11-14T04:55:09.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5ab7b898-698a-4a9d-ba3a-2c0218d8ac16 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96522024-11-14T04:55:09.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5ab7b898-698a-4a9d-ba3a-2c0218d8ac16 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96532024-11-14T04:55:10.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8add214d-65f3-4e7a-b24a-e737d616fc27 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96542024-11-14T04:55:10.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8add214d-65f3-4e7a-b24a-e737d616fc27 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96552024-11-14T04:55:10.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8add214d-65f3-4e7a-b24a-e737d616fc27 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96562024-11-14T04:55:11.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 364281b6-55fd-445f-8cbd-76f2eba5a22f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96572024-11-14T04:55:11.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 364281b6-55fd-445f-8cbd-76f2eba5a22f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96582024-11-14T04:55:11.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 364281b6-55fd-445f-8cbd-76f2eba5a22f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96592024-11-14T04:55:12.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9591889f-de39-409b-a53f-56dd30469075 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96602024-11-14T04:55:12.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9591889f-de39-409b-a53f-56dd30469075 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96612024-11-14T04:55:12.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9591889f-de39-409b-a53f-56dd30469075 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96622024-11-14T04:55:13.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ca1c826e-6030-43fa-9b7a-7981975a89c1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96632024-11-14T04:55:13.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ca1c826e-6030-43fa-9b7a-7981975a89c1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96642024-11-14T04:55:13.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ca1c826e-6030-43fa-9b7a-7981975a89c1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96652024-11-14T04:55:14.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a222874c-92f5-4738-b527-047c8250259a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96662024-11-14T04:55:14.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a222874c-92f5-4738-b527-047c8250259a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96672024-11-14T04:55:14.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a222874c-92f5-4738-b527-047c8250259a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
96682024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
96692024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96702024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
96712024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96722024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
96732024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
96742024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96752024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96762024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
96772024-11-14T04:55:15.306ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
96782024-11-14T04:55:15.306ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
96792024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.201\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
96802024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
96812024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96822024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
96832024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96842024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96852024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
96862024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96872024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
96882024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
96892024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
96902024-11-14T04:55:15.307ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:45:15.307019935 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96912024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96922024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
96932024-11-14T04:55:15.307ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96942024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96952024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
96962024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
96972024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96982024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96992024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
97002024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97012024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97022024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
97032024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97042024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
97052024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
97062024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
97072024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97082024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
97092024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
97102024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
97112024-11-14T04:55:15.307ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
97122024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97132024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
97142024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
97152024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97162024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
97172024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
97182024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97192024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
97202024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
97212024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97222024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
97232024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
97242024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
97252024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
97262024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97272024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97282024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
97292024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
97302024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
97312024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97322024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97332024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97342024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97352024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97362024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97372024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97382024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97392024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97402024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97412024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
97422024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97432024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97442024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97452024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97462024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97472024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97482024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97492024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97502024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97512024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97522024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97532024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97542024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97552024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97562024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97572024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97582024-11-14T04:55:15.307ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 83694896 } })
97592024-11-14T04:55:15.307ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 83697526 } })
97602024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97612024-11-14T04:55:15.307ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97622024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97632024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97642024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97652024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
97662024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
97672024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
97682024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.255816ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
97692024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
97702024-11-14T04:55:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.236246ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
97712024-11-14T04:55:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97722024-11-14T04:55:15.311ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.016146ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97732024-11-14T04:55:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97742024-11-14T04:55:15.312ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97752024-11-14T04:55:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97762024-11-14T04:55:15.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97772024-11-14T04:55:15.315ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:45:15.307019935 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
97782024-11-14T04:55:15.315ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.29477ms iteration = 10 status = {"expiration":"2024-11-14T04:45:15.307019935Z","pruned":[]}
97792024-11-14T04:55:15.315ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 91198263 } })
97802024-11-14T04:55:15.315ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
97812024-11-14T04:55:15.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97822024-11-14T04:55:15.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97832024-11-14T04:55:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97842024-11-14T04:55:15.316ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97852024-11-14T04:55:15.316ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97862024-11-14T04:55:15.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97872024-11-14T04:55:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97882024-11-14T04:55:15.317ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.895287ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
97892024-11-14T04:55:15.318ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97902024-11-14T04:55:15.320ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 95875248 } })
97912024-11-14T04:55:15.320ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
97922024-11-14T04:55:15.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97932024-11-14T04:55:15.321ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97942024-11-14T04:55:15.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97952024-11-14T04:55:15.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97962024-11-14T04:55:15.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97972024-11-14T04:55:15.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97982024-11-14T04:55:15.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97992024-11-14T04:55:15.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98002024-11-14T04:55:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98012024-11-14T04:55:15.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98022024-11-14T04:55:15.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98032024-11-14T04:55:15.332ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98042024-11-14T04:55:15.332ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98052024-11-14T04:55:15.335ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98062024-11-14T04:55:15.335ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98072024-11-14T04:55:15.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98082024-11-14T04:55:15.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98092024-11-14T04:55:15.336ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98102024-11-14T04:55:15.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98112024-11-14T04:55:15.337ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98122024-11-14T04:55:15.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98132024-11-14T04:55:15.340ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98142024-11-14T04:55:15.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98152024-11-14T04:55:15.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98162024-11-14T04:55:15.344ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98172024-11-14T04:55:15.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98182024-11-14T04:55:15.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98192024-11-14T04:55:15.363ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98202024-11-14T04:55:15.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98212024-11-14T04:55:15.369ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98222024-11-14T04:55:15.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98232024-11-14T04:55:15.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98242024-11-14T04:55:15.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98252024-11-14T04:55:15.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.625661ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
98262024-11-14T04:55:15.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98272024-11-14T04:55:15.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98282024-11-14T04:55:15.387ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98292024-11-14T04:55:15.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98302024-11-14T04:55:15.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98312024-11-14T04:55:15.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98322024-11-14T04:55:15.388ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
98332024-11-14T04:55:15.388ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
98342024-11-14T04:55:15.388ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.623874ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
98352024-11-14T04:55:15.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98362024-11-14T04:55:15.390ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98372024-11-14T04:55:15.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98382024-11-14T04:55:15.391ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98392024-11-14T04:55:15.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98402024-11-14T04:55:15.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98412024-11-14T04:55:15.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98422024-11-14T04:55:15.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98432024-11-14T04:55:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98442024-11-14T04:55:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98452024-11-14T04:55:15.395ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98462024-11-14T04:55:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98472024-11-14T04:55:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98482024-11-14T04:55:15.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98492024-11-14T04:55:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98502024-11-14T04:55:15.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.060597ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
98512024-11-14T04:55:15.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98522024-11-14T04:55:15.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98532024-11-14T04:55:15.401ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98542024-11-14T04:55:15.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98552024-11-14T04:55:15.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
98562024-11-14T04:55:15.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98572024-11-14T04:55:15.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98582024-11-14T04:55:15.409ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98592024-11-14T04:55:15.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98602024-11-14T04:55:15.418ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98612024-11-14T04:55:15.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
98622024-11-14T04:55:15.421ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
98632024-11-14T04:55:15.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
98642024-11-14T04:55:15.421ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98652024-11-14T04:55:15.421ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98662024-11-14T04:55:15.421ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98672024-11-14T04:55:15.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98682024-11-14T04:55:15.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98692024-11-14T04:55:15.426ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98702024-11-14T04:55:15.426ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.148751ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98712024-11-14T04:55:15.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98722024-11-14T04:55:15.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98732024-11-14T04:55:15.427ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 120.264232ms iteration = 5 status = {"nsuccess":5}
98742024-11-14T04:55:15.429ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98752024-11-14T04:55:15.429ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
98762024-11-14T04:55:15.429ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.569299ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98772024-11-14T04:55:15.429ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98782024-11-14T04:55:15.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98792024-11-14T04:55:15.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
98802024-11-14T04:55:15.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98812024-11-14T04:55:15.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98822024-11-14T04:55:15.431ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1494, tv_nsec: 207166731 } })
98832024-11-14T04:55:15.431ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
98842024-11-14T04:55:15.438ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98852024-11-14T04:55:15.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 666aaa89-10dc-42ff-8ba9-0e659352d662 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
98862024-11-14T04:55:15.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 666aaa89-10dc-42ff-8ba9-0e659352d662 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
98872024-11-14T04:55:15.472ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98882024-11-14T04:55:15.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98892024-11-14T04:55:15.475ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
98902024-11-14T04:55:15.475ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98912024-11-14T04:55:15.475ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3b3f06d-c011-47f1-877f-693d1ee4d370", "content-length": "26", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
98922024-11-14T04:55:15.475ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98932024-11-14T04:55:15.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 666aaa89-10dc-42ff-8ba9-0e659352d662 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
98942024-11-14T04:55:15.478ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98952024-11-14T04:55:15.479ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
98962024-11-14T04:55:15.479ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98972024-11-14T04:55:15.479ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f683930-097a-43e8-9999-43354d87779c", "content-length": "26", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
98982024-11-14T04:55:15.479ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98992024-11-14T04:55:15.481ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99002024-11-14T04:55:15.485ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
99012024-11-14T04:55:15.485ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
99022024-11-14T04:55:15.485ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
99032024-11-14T04:55:15.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99042024-11-14T04:55:15.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99052024-11-14T04:55:15.487ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
99062024-11-14T04:55:15.487ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
99072024-11-14T04:55:15.487ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
99082024-11-14T04:55:15.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99092024-11-14T04:55:15.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99102024-11-14T04:55:15.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99112024-11-14T04:55:15.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99122024-11-14T04:55:15.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99132024-11-14T04:55:15.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99142024-11-14T04:55:15.498ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99152024-11-14T04:55:15.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99162024-11-14T04:55:15.499ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
99172024-11-14T04:55:15.499ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
99182024-11-14T04:55:15.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99192024-11-14T04:55:15.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99202024-11-14T04:55:15.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 193.555855ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
99212024-11-14T04:55:15.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99222024-11-14T04:55:15.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99232024-11-14T04:55:15.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99242024-11-14T04:55:15.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99252024-11-14T04:55:15.507ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
99262024-11-14T04:55:15.507ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
99272024-11-14T04:55:15.507ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 200.211308ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
99282024-11-14T04:55:15.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99292024-11-14T04:55:15.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 201.126244ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
99302024-11-14T04:55:15.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99312024-11-14T04:55:15.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99322024-11-14T04:55:15.514ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99332024-11-14T04:55:15.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99342024-11-14T04:55:15.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99352024-11-14T04:55:15.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99362024-11-14T04:55:15.517ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99372024-11-14T04:55:15.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99382024-11-14T04:55:15.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99392024-11-14T04:55:15.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99402024-11-14T04:55:15.519ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99412024-11-14T04:55:15.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99422024-11-14T04:55:15.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
99432024-11-14T04:55:15.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99442024-11-14T04:55:15.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99452024-11-14T04:55:15.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 216.84443ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99462024-11-14T04:55:15.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99472024-11-14T04:55:15.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99482024-11-14T04:55:15.545ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
99492024-11-14T04:55:15.545ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
99502024-11-14T04:55:15.545ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99512024-11-14T04:55:15.545ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
99522024-11-14T04:55:15.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 238.017332ms iteration = 10 status = {"generation":1}
99532024-11-14T04:55:15.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
99542024-11-14T04:55:15.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99552024-11-14T04:55:15.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99562024-11-14T04:55:15.553ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 245.744216ms iteration = 19 status = 0
99572024-11-14T04:55:15.555ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
99582024-11-14T04:55:15.555ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
99592024-11-14T04:55:15.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99602024-11-14T04:55:15.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99612024-11-14T04:55:15.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 250.104323ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
99622024-11-14T04:55:15.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99632024-11-14T04:55:15.561ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
99642024-11-14T04:55:15.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 253.937854ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
99652024-11-14T04:55:15.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
99662024-11-14T04:55:15.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99672024-11-14T04:55:15.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99682024-11-14T04:55:15.565ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
99692024-11-14T04:55:15.565ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
99702024-11-14T04:55:15.565ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
99712024-11-14T04:55:15.565ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 258.32506ms iteration = 10 status = {"generation":2}
99722024-11-14T04:55:15.581ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99732024-11-14T04:55:15.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99742024-11-14T04:55:15.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99752024-11-14T04:55:15.597ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
99762024-11-14T04:55:15.597ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 290.624336ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
99772024-11-14T04:55:15.599ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
99782024-11-14T04:55:15.599ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99792024-11-14T04:55:15.599ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa55ca42-06ea-4243-91b3-aacc6b24b105", "content-length": "26", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
99802024-11-14T04:55:15.599ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99812024-11-14T04:55:15.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99822024-11-14T04:55:15.602ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
99832024-11-14T04:55:15.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99842024-11-14T04:55:15.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99852024-11-14T04:55:15.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99862024-11-14T04:55:15.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99872024-11-14T04:55:15.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99882024-11-14T04:55:15.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99892024-11-14T04:55:15.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99902024-11-14T04:55:15.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
99912024-11-14T04:55:15.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99922024-11-14T04:55:15.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
99932024-11-14T04:55:15.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99942024-11-14T04:55:15.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99952024-11-14T04:55:15.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99962024-11-14T04:55:15.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99972024-11-14T04:55:15.669ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 362.390005ms iteration = 19 status = {}
99982024-11-14T04:55:15.693ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 386.096141ms iteration = 21 status = {"physical_disks_added":0}
99992024-11-14T04:55:15.702ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
100002024-11-14T04:55:15.702ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b8f8dce-8e5a-4a7c-b2c7-c9b9d244e94e", "content-length": "1", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100012024-11-14T04:55:15.705ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100022024-11-14T04:55:15.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100032024-11-14T04:55:15.740ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
100042024-11-14T04:55:15.741ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7f52d270-377f-4956-bcbf-7c86360f283c", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100052024-11-14T04:55:15.741ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100062024-11-14T04:55:15.744ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ac872a8e-ece8-4993-a398-eab025b991ce", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100072024-11-14T04:55:15.744ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100082024-11-14T04:55:15.746ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
100092024-11-14T04:55:15.746ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 438.848599ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
100102024-11-14T04:55:15.746ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
100112024-11-14T04:55:15.746ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100122024-11-14T04:55:15.747ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e76ceea-90d5-4556-800c-e3b0f0cc1bd0", "content-length": "372", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100132024-11-14T04:55:15.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100142024-11-14T04:55:15.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100152024-11-14T04:55:15.750ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 443.546194ms iteration = 19 status = null
100162024-11-14T04:55:15.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = abd35dd3-50ff-412f-ab20-01556d36b529 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
100172024-11-14T04:55:15.764ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
100182024-11-14T04:55:15.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = abd35dd3-50ff-412f-ab20-01556d36b529 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
100192024-11-14T04:55:15.765ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8c5a6976-2ed8-4ea8-b03e-49ba6b079139", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
100202024-11-14T04:55:15.765ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
100212024-11-14T04:55:15.767ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f1451e33-e0c7-4a9f-81af-932a05a7c01f", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
100222024-11-14T04:55:15.767ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
100232024-11-14T04:55:15.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = abd35dd3-50ff-412f-ab20-01556d36b529 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
100242024-11-14T04:55:15.769ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c9dd989f-9691-469e-a734-4bd03c17693d", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
100252024-11-14T04:55:15.769ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
100262024-11-14T04:55:15.771ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
100272024-11-14T04:55:15.771ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 464.225934ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
100282024-11-14T04:55:15.789ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
100292024-11-14T04:55:15.789ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 481.981558ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
100302024-11-14T04:55:15.797ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
100312024-11-14T04:55:15.797ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
100322024-11-14T04:55:15.797ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ed0a2a10-a753-4f83-8251-ffa87ca5d852", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100332024-11-14T04:55:15.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100342024-11-14T04:55:15.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100352024-11-14T04:55:15.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100362024-11-14T04:55:15.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100372024-11-14T04:55:15.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100382024-11-14T04:55:15.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100392024-11-14T04:55:15.808ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
100402024-11-14T04:55:15.808ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
100412024-11-14T04:55:15.808ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "39a3a12e-b969-437f-9e1e-113408125608", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100422024-11-14T04:55:15.811ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 504.045216ms iteration = 19 status = {}
100432024-11-14T04:55:15.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100442024-11-14T04:55:15.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100452024-11-14T04:55:15.838ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
100462024-11-14T04:55:15.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100472024-11-14T04:55:15.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100482024-11-14T04:55:15.868ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
100492024-11-14T04:55:15.868ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ab89b84-0d9a-4c68-8bdb-a944d3c3fabc", "content-length": "691", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100502024-11-14T04:55:15.868ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
100512024-11-14T04:55:15.868ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
100522024-11-14T04:55:15.868ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
100532024-11-14T04:55:15.870ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 563.012604ms iteration = 19 status = {}
100542024-11-14T04:55:15.880ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
100552024-11-14T04:55:15.880ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa14a907-2bc7-4264-8585-f5e49703f65b", "content-length": "134", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100562024-11-14T04:55:15.880ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
100572024-11-14T04:55:15.880ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
100582024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
100592024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
100602024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100612024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100622024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100632024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100642024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
100652024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
100662024-11-14T04:55:15.881ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
100672024-11-14T04:55:15.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100682024-11-14T04:55:15.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100692024-11-14T04:55:15.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
100702024-11-14T04:55:15.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b41dbce-0536-468b-a72a-37d291322c76", "content-length": "2", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100712024-11-14T04:55:15.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
100722024-11-14T04:55:15.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0538561-a812-4d7d-8ac9-2ecebdc23e24", "content-length": "51", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100732024-11-14T04:55:15.883ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
100742024-11-14T04:55:15.883ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
100752024-11-14T04:55:16.003ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d4c8f961-72a5-4199-a12d-98438a84f593", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100762024-11-14T04:55:16.003ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
100772024-11-14T04:55:16.003ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
100782024-11-14T04:55:16.004ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac0cb3cb-14ba-44fb-9a1a-0ed9c6e209c9", "content-length": "682", "date": "Thu, 14 Nov 2024 04:55:15 GMT"} })
100792024-11-14T04:55:16.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100802024-11-14T04:55:16.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100812024-11-14T04:55:16.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100822024-11-14T04:55:16.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100832024-11-14T04:55:16.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100842024-11-14T04:55:16.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100852024-11-14T04:55:16.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100862024-11-14T04:55:16.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100872024-11-14T04:55:16.019ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 712.435561ms iteration = 19 status = {}
100882024-11-14T04:55:16.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26e7fb9d-23af-4150-9926-e80091412d06 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100892024-11-14T04:55:16.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26e7fb9d-23af-4150-9926-e80091412d06 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100902024-11-14T04:55:16.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26e7fb9d-23af-4150-9926-e80091412d06 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100912024-11-14T04:55:17.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f27f32ad-5aa5-4032-9000-9fc4850a2bc4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100922024-11-14T04:55:17.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f27f32ad-5aa5-4032-9000-9fc4850a2bc4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100932024-11-14T04:55:17.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f27f32ad-5aa5-4032-9000-9fc4850a2bc4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100942024-11-14T04:55:18.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a77ea3d8-e138-40d5-8f6e-980b209adee4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100952024-11-14T04:55:18.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a77ea3d8-e138-40d5-8f6e-980b209adee4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100962024-11-14T04:55:18.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a77ea3d8-e138-40d5-8f6e-980b209adee4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100972024-11-14T04:55:19.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07ad235c-e123-484d-b935-e3e40bef65d6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100982024-11-14T04:55:19.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07ad235c-e123-484d-b935-e3e40bef65d6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
100992024-11-14T04:55:19.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07ad235c-e123-484d-b935-e3e40bef65d6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101002024-11-14T04:55:20.258ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 115f7d8c-0980-4468-a6ee-a21ecce43ca4 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
101012024-11-14T04:55:20.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 74887aa5-d59b-4404-9259-2c63c31d33d8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101022024-11-14T04:55:20.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 74887aa5-d59b-4404-9259-2c63c31d33d8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101032024-11-14T04:55:20.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 74887aa5-d59b-4404-9259-2c63c31d33d8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101042024-11-14T04:55:21.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5b1a124a-af79-4e6b-9e76-702da20450ee roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101052024-11-14T04:55:21.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5b1a124a-af79-4e6b-9e76-702da20450ee resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101062024-11-14T04:55:21.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5b1a124a-af79-4e6b-9e76-702da20450ee response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101072024-11-14T04:55:22.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1fe05ee1-6678-4fd6-a0ad-142b4d63df29 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101082024-11-14T04:55:22.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1fe05ee1-6678-4fd6-a0ad-142b4d63df29 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101092024-11-14T04:55:22.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1fe05ee1-6678-4fd6-a0ad-142b4d63df29 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101102024-11-14T04:55:23.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6f16393-8a46-4669-8e87-949598c5376f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101112024-11-14T04:55:23.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6f16393-8a46-4669-8e87-949598c5376f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101122024-11-14T04:55:23.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6f16393-8a46-4669-8e87-949598c5376f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101132024-11-14T04:55:24.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e63e1266-12da-46c2-9eca-9686e21f9b3f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101142024-11-14T04:55:24.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e63e1266-12da-46c2-9eca-9686e21f9b3f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101152024-11-14T04:55:24.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e63e1266-12da-46c2-9eca-9686e21f9b3f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101162024-11-14T04:55:25.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
101172024-11-14T04:55:25.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101182024-11-14T04:55:25.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
101192024-11-14T04:55:25.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101202024-11-14T04:55:25.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101212024-11-14T04:55:25.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101222024-11-14T04:55:25.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101232024-11-14T04:55:25.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101242024-11-14T04:55:25.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101252024-11-14T04:55:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101262024-11-14T04:55:25.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101272024-11-14T04:55:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101282024-11-14T04:55:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101292024-11-14T04:55:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101302024-11-14T04:55:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101312024-11-14T04:55:25.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
101322024-11-14T04:55:25.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101332024-11-14T04:55:25.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101342024-11-14T04:55:25.332ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
101352024-11-14T04:55:25.332ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.491808ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
101362024-11-14T04:55:25.341ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.803918ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101372024-11-14T04:55:25.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aeb2f4eb-309c-41a5-b171-29e1c0b77eca roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101382024-11-14T04:55:25.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aeb2f4eb-309c-41a5-b171-29e1c0b77eca resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101392024-11-14T04:55:25.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aeb2f4eb-309c-41a5-b171-29e1c0b77eca response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101402024-11-14T04:55:26.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e50990a7-485d-42e3-8b76-da1ee64fb9fc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101412024-11-14T04:55:26.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e50990a7-485d-42e3-8b76-da1ee64fb9fc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101422024-11-14T04:55:26.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e50990a7-485d-42e3-8b76-da1ee64fb9fc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101432024-11-14T04:55:27.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9706de36-002c-4e82-9513-45554d0c0a10 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101442024-11-14T04:55:27.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9706de36-002c-4e82-9513-45554d0c0a10 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101452024-11-14T04:55:27.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9706de36-002c-4e82-9513-45554d0c0a10 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101462024-11-14T04:55:28.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0e567f7-3781-48b5-bf9c-f17f158e6277 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101472024-11-14T04:55:28.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0e567f7-3781-48b5-bf9c-f17f158e6277 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101482024-11-14T04:55:28.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0e567f7-3781-48b5-bf9c-f17f158e6277 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101492024-11-14T04:55:29.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aff439af-1c14-4c6c-afc8-324a14154917 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101502024-11-14T04:55:29.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aff439af-1c14-4c6c-afc8-324a14154917 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101512024-11-14T04:55:29.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aff439af-1c14-4c6c-afc8-324a14154917 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101522024-11-14T04:55:30.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26851d41-ef0f-4593-9725-6430f772dd00 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101532024-11-14T04:55:30.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26851d41-ef0f-4593-9725-6430f772dd00 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101542024-11-14T04:55:30.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26851d41-ef0f-4593-9725-6430f772dd00 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101552024-11-14T04:55:31.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 453216f6-59e2-4e00-bf50-a0e33cd69fc8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101562024-11-14T04:55:31.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 453216f6-59e2-4e00-bf50-a0e33cd69fc8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101572024-11-14T04:55:31.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 453216f6-59e2-4e00-bf50-a0e33cd69fc8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101582024-11-14T04:55:32.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a94745b-a87e-40fc-88fa-cf11efcd5702 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101592024-11-14T04:55:32.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a94745b-a87e-40fc-88fa-cf11efcd5702 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101602024-11-14T04:55:32.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4a94745b-a87e-40fc-88fa-cf11efcd5702 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101612024-11-14T04:55:33.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c0296db8-6c93-4263-8587-f5d9dc414780 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101622024-11-14T04:55:33.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c0296db8-6c93-4263-8587-f5d9dc414780 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101632024-11-14T04:55:33.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c0296db8-6c93-4263-8587-f5d9dc414780 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101642024-11-14T04:55:34.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 029ecff3-1f9b-41da-b95c-36a16f5c19f0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101652024-11-14T04:55:34.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 029ecff3-1f9b-41da-b95c-36a16f5c19f0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101662024-11-14T04:55:34.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 029ecff3-1f9b-41da-b95c-36a16f5c19f0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101672024-11-14T04:55:35.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 8b7aad42-545e-445a-ad7f-9cbfc14fbf6c response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
101682024-11-14T04:55:35.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
101692024-11-14T04:55:35.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101702024-11-14T04:55:35.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
101712024-11-14T04:55:35.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101722024-11-14T04:55:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101732024-11-14T04:55:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101742024-11-14T04:55:35.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101752024-11-14T04:55:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101762024-11-14T04:55:35.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101772024-11-14T04:55:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101782024-11-14T04:55:35.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101792024-11-14T04:55:35.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101802024-11-14T04:55:35.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101812024-11-14T04:55:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
101822024-11-14T04:55:35.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101832024-11-14T04:55:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101842024-11-14T04:55:35.327ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
101852024-11-14T04:55:35.327ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.641378ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
101862024-11-14T04:55:35.335ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101872024-11-14T04:55:35.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101882024-11-14T04:55:35.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.231728ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101892024-11-14T04:55:35.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07f171f6-0956-4ead-a410-5737ed3999d1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101902024-11-14T04:55:35.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07f171f6-0956-4ead-a410-5737ed3999d1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101912024-11-14T04:55:35.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 07f171f6-0956-4ead-a410-5737ed3999d1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101922024-11-14T04:55:36.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8991fa68-7b72-46b3-b79c-34a420fed806 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101932024-11-14T04:55:36.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8991fa68-7b72-46b3-b79c-34a420fed806 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101942024-11-14T04:55:36.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8991fa68-7b72-46b3-b79c-34a420fed806 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101952024-11-14T04:55:37.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e7546b6a-6bf2-4f79-9236-59303bcc8d8b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101962024-11-14T04:55:37.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e7546b6a-6bf2-4f79-9236-59303bcc8d8b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101972024-11-14T04:55:37.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e7546b6a-6bf2-4f79-9236-59303bcc8d8b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101982024-11-14T04:55:39.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0301e7f9-861c-4460-bfc0-c281aafcfbfe roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
101992024-11-14T04:55:39.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0301e7f9-861c-4460-bfc0-c281aafcfbfe resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102002024-11-14T04:55:39.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0301e7f9-861c-4460-bfc0-c281aafcfbfe response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102012024-11-14T04:55:40.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3751e836-56be-4fc8-ba46-55a512d02498 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102022024-11-14T04:55:40.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3751e836-56be-4fc8-ba46-55a512d02498 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102032024-11-14T04:55:40.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3751e836-56be-4fc8-ba46-55a512d02498 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102042024-11-14T04:55:40.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 59bdbbd3-82ac-4f4b-9926-162f1c66c5b7 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
102052024-11-14T04:55:40.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 59bdbbd3-82ac-4f4b-9926-162f1c66c5b7 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
102062024-11-14T04:55:40.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 59bdbbd3-82ac-4f4b-9926-162f1c66c5b7 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
102072024-11-14T04:55:40.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 174eda68-74b6-4300-b8b6-4fac98f83cd7 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
102082024-11-14T04:55:40.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 174eda68-74b6-4300-b8b6-4fac98f83cd7 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
102092024-11-14T04:55:40.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 174eda68-74b6-4300-b8b6-4fac98f83cd7 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
102102024-11-14T04:55:41.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bea77ff6-b377-4f9f-be97-aeb8082375c4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102112024-11-14T04:55:41.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bea77ff6-b377-4f9f-be97-aeb8082375c4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102122024-11-14T04:55:41.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bea77ff6-b377-4f9f-be97-aeb8082375c4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102132024-11-14T04:55:42.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 274bf7a6-5c33-4052-ba75-78d553d8e191 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102142024-11-14T04:55:42.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 274bf7a6-5c33-4052-ba75-78d553d8e191 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102152024-11-14T04:55:42.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 274bf7a6-5c33-4052-ba75-78d553d8e191 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102162024-11-14T04:55:43.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 738f1025-9fd3-4268-9e33-641ccc64643f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102172024-11-14T04:55:43.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 738f1025-9fd3-4268-9e33-641ccc64643f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102182024-11-14T04:55:43.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 738f1025-9fd3-4268-9e33-641ccc64643f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102192024-11-14T04:55:44.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fb5ac1f-53df-4bec-adeb-87df27968c12 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102202024-11-14T04:55:44.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fb5ac1f-53df-4bec-adeb-87df27968c12 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102212024-11-14T04:55:44.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fb5ac1f-53df-4bec-adeb-87df27968c12 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102222024-11-14T04:55:45.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d06ecb77-0c25-435e-88d8-9432973fc05e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102232024-11-14T04:55:45.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d06ecb77-0c25-435e-88d8-9432973fc05e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102242024-11-14T04:55:45.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d06ecb77-0c25-435e-88d8-9432973fc05e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
102252024-11-14T04:55:45.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
102262024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
102272024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102282024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
102292024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102302024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102312024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
102322024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
102332024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
102342024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102352024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102362024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
102372024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
102382024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
102392024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102402024-11-14T04:55:45.307ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102412024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
102422024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102432024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102442024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
102452024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
102462024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
102472024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102482024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
102492024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102502024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
102512024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102522024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
102532024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102542024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
102552024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102562024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
102572024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
102582024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102592024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102602024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102612024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102622024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102632024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
102642024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102652024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102662024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102672024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102682024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102692024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102702024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102712024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102722024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102732024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102742024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102752024-11-14T04:55:45.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102762024-11-14T04:55:45.309ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102772024-11-14T04:55:45.310ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102782024-11-14T04:55:45.310ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.176082ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102792024-11-14T04:55:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102802024-11-14T04:55:45.311ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 87645696 } })
102812024-11-14T04:55:45.311ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
102822024-11-14T04:55:45.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102832024-11-14T04:55:45.312ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102842024-11-14T04:55:45.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102852024-11-14T04:55:45.313ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102862024-11-14T04:55:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102872024-11-14T04:55:45.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102882024-11-14T04:55:45.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.498727ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
102892024-11-14T04:55:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102902024-11-14T04:55:45.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102912024-11-14T04:55:45.315ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102922024-11-14T04:55:45.315ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102932024-11-14T04:55:45.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102942024-11-14T04:55:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102952024-11-14T04:55:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102962024-11-14T04:55:45.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102972024-11-14T04:55:45.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102982024-11-14T04:55:45.318ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 94359200 } })
102992024-11-14T04:55:45.318ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
103002024-11-14T04:55:45.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
103012024-11-14T04:55:45.318ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103022024-11-14T04:55:45.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103032024-11-14T04:55:45.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
103042024-11-14T04:55:45.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103052024-11-14T04:55:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103062024-11-14T04:55:45.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103072024-11-14T04:55:45.321ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103082024-11-14T04:55:45.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103092024-11-14T04:55:45.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103102024-11-14T04:55:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103112024-11-14T04:55:45.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103122024-11-14T04:55:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103132024-11-14T04:55:45.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103142024-11-14T04:55:45.324ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103152024-11-14T04:55:45.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103162024-11-14T04:55:45.325ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103172024-11-14T04:55:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103182024-11-14T04:55:45.327ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103192024-11-14T04:55:45.327ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103202024-11-14T04:55:45.327ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103212024-11-14T04:55:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103222024-11-14T04:55:45.328ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1524, tv_nsec: 105082451 } })
103232024-11-14T04:55:45.329ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
103242024-11-14T04:55:45.329ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103252024-11-14T04:55:45.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103262024-11-14T04:55:45.333ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103272024-11-14T04:55:45.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103282024-11-14T04:55:45.342ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103292024-11-14T04:55:45.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103302024-11-14T04:55:45.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.697463ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
103312024-11-14T04:55:45.366ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.349899ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103322024-11-14T04:55:45.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103332024-11-14T04:55:45.371ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103342024-11-14T04:55:45.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103352024-11-14T04:55:45.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103362024-11-14T04:55:45.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103372024-11-14T04:55:45.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103382024-11-14T04:55:45.380ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103392024-11-14T04:55:45.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103402024-11-14T04:55:45.382ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103412024-11-14T04:55:45.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103422024-11-14T04:55:45.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103432024-11-14T04:55:45.385ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.347469ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
103442024-11-14T04:55:45.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
103452024-11-14T04:55:45.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103462024-11-14T04:55:45.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103472024-11-14T04:55:45.395ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.162203ms iteration = 20 status = 0
103482024-11-14T04:55:45.396ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
103492024-11-14T04:55:45.396ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.365797ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
103502024-11-14T04:55:45.402ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103512024-11-14T04:55:45.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103522024-11-14T04:55:45.412ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.014961ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103532024-11-14T04:55:45.414ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.031729ms iteration = 22 status = {"physical_disks_added":0}
103542024-11-14T04:55:45.415ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103552024-11-14T04:55:45.415ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103562024-11-14T04:55:45.415ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.045239ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103572024-11-14T04:55:45.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103582024-11-14T04:55:45.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
103592024-11-14T04:55:45.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103602024-11-14T04:55:45.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103612024-11-14T04:55:45.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103622024-11-14T04:55:45.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103632024-11-14T04:55:45.435ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
103642024-11-14T04:55:45.435ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 128.159572ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
103652024-11-14T04:55:45.451ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
103662024-11-14T04:55:45.451ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103672024-11-14T04:55:45.451ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "711c0b94-a6c0-4721-80c4-6ac25bffd391", "content-length": "26", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
103682024-11-14T04:55:45.451ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103692024-11-14T04:55:45.453ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103702024-11-14T04:55:45.461ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
103712024-11-14T04:55:45.461ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103722024-11-14T04:55:45.461ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e2f8d10-60e2-4c3a-823d-452f57fc7754", "content-length": "26", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
103732024-11-14T04:55:45.461ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103742024-11-14T04:55:45.463ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103752024-11-14T04:55:45.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 161.098336ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
103762024-11-14T04:55:45.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103772024-11-14T04:55:45.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103782024-11-14T04:55:45.516ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
103792024-11-14T04:55:45.516ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103802024-11-14T04:55:45.516ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "956c569c-b961-4058-904c-770c11a4e078", "content-length": "26", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
103812024-11-14T04:55:45.516ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103822024-11-14T04:55:45.518ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
103832024-11-14T04:55:45.566ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103842024-11-14T04:55:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103852024-11-14T04:55:45.578ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103862024-11-14T04:55:45.578ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "950b22dd-cfe3-43f2-9913-57393aeabe7f", "content-length": "1", "date": "Thu, 14 Nov 2024 04:55:44 GMT"} })
103872024-11-14T04:55:45.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103882024-11-14T04:55:45.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103892024-11-14T04:55:45.583ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 276.426685ms iteration = 20 status = {}
103902024-11-14T04:55:45.598ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103912024-11-14T04:55:45.598ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103922024-11-14T04:55:45.598ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e394f19c-d428-48dd-a4d5-20fc18bed89a", "content-length": "372", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
103932024-11-14T04:55:45.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103942024-11-14T04:55:45.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103952024-11-14T04:55:45.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103962024-11-14T04:55:45.600ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 293.645584ms iteration = 20 status = null
103972024-11-14T04:55:45.601ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103982024-11-14T04:55:45.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103992024-11-14T04:55:45.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104002024-11-14T04:55:45.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104012024-11-14T04:55:45.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104022024-11-14T04:55:45.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104032024-11-14T04:55:45.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104042024-11-14T04:55:45.612ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
104052024-11-14T04:55:45.612ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
104062024-11-14T04:55:45.613ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e10271dd-749d-42f3-8544-822d78c358bd", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
104072024-11-14T04:55:45.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104082024-11-14T04:55:45.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104092024-11-14T04:55:45.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104102024-11-14T04:55:45.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104112024-11-14T04:55:45.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104122024-11-14T04:55:45.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104132024-11-14T04:55:45.620ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104142024-11-14T04:55:45.620ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104152024-11-14T04:55:45.621ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c7a5b84e-4921-41cc-ab09-8f6d3616c327", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
104162024-11-14T04:55:45.623ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 316.127875ms iteration = 20 status = {}
104172024-11-14T04:55:45.666ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104182024-11-14T04:55:45.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104192024-11-14T04:55:45.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104202024-11-14T04:55:45.709ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
104212024-11-14T04:55:45.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104222024-11-14T04:55:45.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104232024-11-14T04:55:45.719ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
104242024-11-14T04:55:45.720ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc4512e3-8e57-45c8-a689-9690a1c9f5ae", "content-length": "134", "date": "Thu, 14 Nov 2024 04:55:44 GMT"} })
104252024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
104262024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
104272024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
104282024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
104292024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104302024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104312024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104322024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104332024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104342024-11-14T04:55:45.720ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
104352024-11-14T04:55:45.721ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
104362024-11-14T04:55:45.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104372024-11-14T04:55:45.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104382024-11-14T04:55:45.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
104392024-11-14T04:55:45.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dac4293-8e43-45ac-bc93-502069eb25d7", "content-length": "2", "date": "Thu, 14 Nov 2024 04:55:44 GMT"} })
104402024-11-14T04:55:45.722ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
104412024-11-14T04:55:45.722ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "08bcbba1-75ed-4762-86b1-a4fa54ed8fd1", "content-length": "51", "date": "Thu, 14 Nov 2024 04:55:44 GMT"} })
104422024-11-14T04:55:45.722ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
104432024-11-14T04:55:45.722ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
104442024-11-14T04:55:45.762ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a88fbbe3-4bb2-4dce-b88c-0b5624fc6996", "content-length": "691", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
104452024-11-14T04:55:45.762ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
104462024-11-14T04:55:45.762ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
104472024-11-14T04:55:45.762ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
104482024-11-14T04:55:45.764ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 457.310563ms iteration = 20 status = {}
104492024-11-14T04:55:45.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 3b43ed5d-9d98-43b6-8e04-ded3780a2c6b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
104502024-11-14T04:55:45.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 3b43ed5d-9d98-43b6-8e04-ded3780a2c6b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
104512024-11-14T04:55:45.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 3b43ed5d-9d98-43b6-8e04-ded3780a2c6b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
104522024-11-14T04:55:45.877ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f50d57b4-dc25-44e1-b77e-a6b8bb7c5278", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
104532024-11-14T04:55:45.877ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
104542024-11-14T04:55:45.877ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104552024-11-14T04:55:45.881ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdd39984-fe29-44e5-b5b5-7bd8a63f651e", "content-length": "682", "date": "Thu, 14 Nov 2024 04:55:45 GMT"} })
104562024-11-14T04:55:45.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104572024-11-14T04:55:45.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104582024-11-14T04:55:45.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104592024-11-14T04:55:45.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104602024-11-14T04:55:45.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104612024-11-14T04:55:45.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104622024-11-14T04:55:45.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104632024-11-14T04:55:45.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104642024-11-14T04:55:45.898ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 591.343194ms iteration = 20 status = {}
104652024-11-14T04:55:46.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e6260a9b-6dc2-476c-9c3c-b94ecf4caf80 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104662024-11-14T04:55:46.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e6260a9b-6dc2-476c-9c3c-b94ecf4caf80 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104672024-11-14T04:55:46.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e6260a9b-6dc2-476c-9c3c-b94ecf4caf80 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104682024-11-14T04:55:47.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd454b19-9185-4e8d-a76c-3009bf4a04a5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104692024-11-14T04:55:47.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd454b19-9185-4e8d-a76c-3009bf4a04a5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104702024-11-14T04:55:47.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd454b19-9185-4e8d-a76c-3009bf4a04a5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104712024-11-14T04:55:48.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4df4dd92-6013-498e-bdc5-e847aa2f3126 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104722024-11-14T04:55:48.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4df4dd92-6013-498e-bdc5-e847aa2f3126 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104732024-11-14T04:55:48.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4df4dd92-6013-498e-bdc5-e847aa2f3126 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104742024-11-14T04:55:49.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1bbee084-aeb0-4654-911f-4961b29e7bef roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104752024-11-14T04:55:49.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1bbee084-aeb0-4654-911f-4961b29e7bef resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104762024-11-14T04:55:49.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1bbee084-aeb0-4654-911f-4961b29e7bef response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104772024-11-14T04:55:50.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = c35f6829-87b6-4bff-aea8-edb355a1384b response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
104782024-11-14T04:55:50.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c25cece9-8fff-4547-9ead-bc63dd360201 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104792024-11-14T04:55:50.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c25cece9-8fff-4547-9ead-bc63dd360201 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104802024-11-14T04:55:50.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c25cece9-8fff-4547-9ead-bc63dd360201 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104812024-11-14T04:55:51.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7d9768f-6d39-40ad-89d0-61cdcfc258cc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104822024-11-14T04:55:51.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7d9768f-6d39-40ad-89d0-61cdcfc258cc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104832024-11-14T04:55:51.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7d9768f-6d39-40ad-89d0-61cdcfc258cc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104842024-11-14T04:55:52.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5b2cad9-08d1-4ea8-a0a5-b1ed96bb486e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104852024-11-14T04:55:52.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5b2cad9-08d1-4ea8-a0a5-b1ed96bb486e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104862024-11-14T04:55:52.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5b2cad9-08d1-4ea8-a0a5-b1ed96bb486e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104872024-11-14T04:55:53.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a313f826-539b-45e7-9d92-68cbf46c6520 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104882024-11-14T04:55:53.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a313f826-539b-45e7-9d92-68cbf46c6520 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104892024-11-14T04:55:53.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a313f826-539b-45e7-9d92-68cbf46c6520 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104902024-11-14T04:55:54.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 523438a4-7afb-46dd-bfe3-b0d8ed016de2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104912024-11-14T04:55:54.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 523438a4-7afb-46dd-bfe3-b0d8ed016de2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104922024-11-14T04:55:54.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 523438a4-7afb-46dd-bfe3-b0d8ed016de2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
104932024-11-14T04:55:55.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
104942024-11-14T04:55:55.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104952024-11-14T04:55:55.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
104962024-11-14T04:55:55.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104972024-11-14T04:55:55.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104982024-11-14T04:55:55.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104992024-11-14T04:55:55.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105002024-11-14T04:55:55.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105012024-11-14T04:55:55.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105022024-11-14T04:55:55.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.80194ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105032024-11-14T04:55:55.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105042024-11-14T04:55:55.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105052024-11-14T04:55:55.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105062024-11-14T04:55:55.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105072024-11-14T04:55:55.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105082024-11-14T04:55:55.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105092024-11-14T04:55:55.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
105102024-11-14T04:55:55.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105112024-11-14T04:55:55.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105122024-11-14T04:55:55.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
105132024-11-14T04:55:55.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.441448ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
105142024-11-14T04:55:55.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b82dd34d-1d7e-49b6-99df-7e88c48c036c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105152024-11-14T04:55:55.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b82dd34d-1d7e-49b6-99df-7e88c48c036c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105162024-11-14T04:55:55.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b82dd34d-1d7e-49b6-99df-7e88c48c036c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105172024-11-14T04:55:56.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0b529461-db01-484d-b7dd-59b5629f04ea roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105182024-11-14T04:55:56.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0b529461-db01-484d-b7dd-59b5629f04ea resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105192024-11-14T04:55:56.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0b529461-db01-484d-b7dd-59b5629f04ea response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105202024-11-14T04:55:57.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13c7ada8-bab4-4683-8f59-2cd50bd71436 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105212024-11-14T04:55:57.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13c7ada8-bab4-4683-8f59-2cd50bd71436 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105222024-11-14T04:55:57.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13c7ada8-bab4-4683-8f59-2cd50bd71436 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105232024-11-14T04:55:58.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38140359-21c9-42da-bf5d-185481250fd4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105242024-11-14T04:55:58.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38140359-21c9-42da-bf5d-185481250fd4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105252024-11-14T04:55:58.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 38140359-21c9-42da-bf5d-185481250fd4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105262024-11-14T04:55:59.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0613f2bc-e0ae-4193-b10e-b2707fec6e42 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105272024-11-14T04:55:59.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0613f2bc-e0ae-4193-b10e-b2707fec6e42 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105282024-11-14T04:55:59.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0613f2bc-e0ae-4193-b10e-b2707fec6e42 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105292024-11-14T04:56:00.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd15e246-a65b-4473-85fe-34888bc66ee8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105302024-11-14T04:56:00.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd15e246-a65b-4473-85fe-34888bc66ee8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105312024-11-14T04:56:00.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd15e246-a65b-4473-85fe-34888bc66ee8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105322024-11-14T04:56:01.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 013bfc47-5ab7-4aa4-859c-f7622e60dba0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105332024-11-14T04:56:01.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 013bfc47-5ab7-4aa4-859c-f7622e60dba0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105342024-11-14T04:56:01.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 013bfc47-5ab7-4aa4-859c-f7622e60dba0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105352024-11-14T04:56:02.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 857d3b79-6880-49d2-be94-208eb21718a4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105362024-11-14T04:56:02.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 857d3b79-6880-49d2-be94-208eb21718a4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105372024-11-14T04:56:02.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 857d3b79-6880-49d2-be94-208eb21718a4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105382024-11-14T04:56:03.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a1de6b9-43ae-45fb-af52-a5963fb6542f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105392024-11-14T04:56:03.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a1de6b9-43ae-45fb-af52-a5963fb6542f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105402024-11-14T04:56:03.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7a1de6b9-43ae-45fb-af52-a5963fb6542f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105412024-11-14T04:56:04.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e6243a19-6ec8-4b39-a53c-f42797a50b98 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105422024-11-14T04:56:04.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e6243a19-6ec8-4b39-a53c-f42797a50b98 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105432024-11-14T04:56:04.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e6243a19-6ec8-4b39-a53c-f42797a50b98 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105442024-11-14T04:56:05.256ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 471 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = fab58f2d-2488-49a6-b04e-4a1bd1f1e3ad response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
105452024-11-14T04:56:05.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
105462024-11-14T04:56:05.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105472024-11-14T04:56:05.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
105482024-11-14T04:56:05.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105492024-11-14T04:56:05.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105502024-11-14T04:56:05.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105512024-11-14T04:56:05.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105522024-11-14T04:56:05.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105532024-11-14T04:56:05.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105542024-11-14T04:56:05.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.44023ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105552024-11-14T04:56:05.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105562024-11-14T04:56:05.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105572024-11-14T04:56:05.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105582024-11-14T04:56:05.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105592024-11-14T04:56:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105602024-11-14T04:56:05.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105612024-11-14T04:56:05.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
105622024-11-14T04:56:05.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105632024-11-14T04:56:05.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105642024-11-14T04:56:05.328ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
105652024-11-14T04:56:05.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.152341ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
105662024-11-14T04:56:05.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a41d9b05-ae76-4330-bd28-1f8a4d1bd7a3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105672024-11-14T04:56:05.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a41d9b05-ae76-4330-bd28-1f8a4d1bd7a3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105682024-11-14T04:56:05.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a41d9b05-ae76-4330-bd28-1f8a4d1bd7a3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105692024-11-14T04:56:06.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4727aa1c-7716-4978-b821-d32f024d63e2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105702024-11-14T04:56:06.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4727aa1c-7716-4978-b821-d32f024d63e2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105712024-11-14T04:56:06.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4727aa1c-7716-4978-b821-d32f024d63e2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105722024-11-14T04:56:07.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b548ecd-6f03-4387-b431-99738237fc9c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105732024-11-14T04:56:07.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b548ecd-6f03-4387-b431-99738237fc9c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105742024-11-14T04:56:07.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b548ecd-6f03-4387-b431-99738237fc9c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105752024-11-14T04:56:08.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2b41fd4-31df-4c4e-8a34-cedb2feb4672 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105762024-11-14T04:56:08.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2b41fd4-31df-4c4e-8a34-cedb2feb4672 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105772024-11-14T04:56:08.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d2b41fd4-31df-4c4e-8a34-cedb2feb4672 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105782024-11-14T04:56:09.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bcefb4cd-a409-4db2-8b8c-efc40df4d56a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105792024-11-14T04:56:09.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bcefb4cd-a409-4db2-8b8c-efc40df4d56a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105802024-11-14T04:56:09.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bcefb4cd-a409-4db2-8b8c-efc40df4d56a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105812024-11-14T04:56:10.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 4031c012-1f2f-462f-8225-3b3e115f6af1 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
105822024-11-14T04:56:10.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 4031c012-1f2f-462f-8225-3b3e115f6af1 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
105832024-11-14T04:56:10.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 4031c012-1f2f-462f-8225-3b3e115f6af1 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
105842024-11-14T04:56:10.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 0efaa10b-6cf3-438d-a785-f7d6866d3cb8 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
105852024-11-14T04:56:10.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 0efaa10b-6cf3-438d-a785-f7d6866d3cb8 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
105862024-11-14T04:56:10.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 0efaa10b-6cf3-438d-a785-f7d6866d3cb8 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
105872024-11-14T04:56:10.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d015cd5f-c053-4fcd-a3dd-a76ac593c48c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105882024-11-14T04:56:10.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d015cd5f-c053-4fcd-a3dd-a76ac593c48c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105892024-11-14T04:56:10.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d015cd5f-c053-4fcd-a3dd-a76ac593c48c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105902024-11-14T04:56:11.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e79f56fb-f1db-4d0a-bc06-51ad0b0eb8d6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105912024-11-14T04:56:11.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e79f56fb-f1db-4d0a-bc06-51ad0b0eb8d6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105922024-11-14T04:56:11.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e79f56fb-f1db-4d0a-bc06-51ad0b0eb8d6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105932024-11-14T04:56:12.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bfb87673-0c18-49dc-88f8-49a1aaf3c215 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105942024-11-14T04:56:12.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bfb87673-0c18-49dc-88f8-49a1aaf3c215 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105952024-11-14T04:56:12.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bfb87673-0c18-49dc-88f8-49a1aaf3c215 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105962024-11-14T04:56:13.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dcd82b72-c096-4a4d-928c-5e963c82b1cb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105972024-11-14T04:56:13.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dcd82b72-c096-4a4d-928c-5e963c82b1cb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105982024-11-14T04:56:13.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dcd82b72-c096-4a4d-928c-5e963c82b1cb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
105992024-11-14T04:56:14.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5dc46cea-962d-4025-b842-5228c7552e72 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
106002024-11-14T04:56:14.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5dc46cea-962d-4025-b842-5228c7552e72 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
106012024-11-14T04:56:14.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5dc46cea-962d-4025-b842-5228c7552e72 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
106022024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
106032024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106042024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
106052024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
106062024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
106072024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
106082024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106092024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
106102024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
106112024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106122024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
106132024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106142024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
106152024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
106162024-11-14T04:56:15.306ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
106172024-11-14T04:56:15.306ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
106182024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
106192024-11-14T04:56:15.306ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
106202024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.32\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
106212024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
106222024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
106232024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
106242024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106252024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
106262024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
106272024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
106282024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
106292024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
106302024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
106312024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
106322024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106332024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
106342024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
106352024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
106362024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106372024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
106382024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
106392024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
106402024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106412024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
106422024-11-14T04:56:15.306ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:46:15.306802458 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
106432024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
106442024-11-14T04:56:15.306ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
106452024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
106462024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106472024-11-14T04:56:15.307ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
106482024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106492024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
106502024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106512024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
106522024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106532024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
106542024-11-14T04:56:15.307ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
106552024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106562024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
106572024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106582024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
106592024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
106602024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
106612024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106622024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
106632024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
106642024-11-14T04:56:15.307ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
106652024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106662024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
106672024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106682024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
106692024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106702024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106712024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106722024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106732024-11-14T04:56:15.307ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
106742024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106752024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106762024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106772024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106782024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106792024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
106802024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106812024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106822024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
106832024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106842024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106852024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106862024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106872024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
106882024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106892024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106902024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106912024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106922024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106932024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106942024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106952024-11-14T04:56:15.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106962024-11-14T04:56:15.307ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 83998116 } })
106972024-11-14T04:56:15.307ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 84001986 } })
106982024-11-14T04:56:15.308ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
106992024-11-14T04:56:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.212575ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
107002024-11-14T04:56:15.308ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
107012024-11-14T04:56:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.471252ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
107022024-11-14T04:56:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107032024-11-14T04:56:15.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107042024-11-14T04:56:15.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107052024-11-14T04:56:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.073529ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
107062024-11-14T04:56:15.310ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107072024-11-14T04:56:15.311ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 87845048 } })
107082024-11-14T04:56:15.311ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
107092024-11-14T04:56:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107102024-11-14T04:56:15.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107112024-11-14T04:56:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107122024-11-14T04:56:15.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107132024-11-14T04:56:15.312ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107142024-11-14T04:56:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107152024-11-14T04:56:15.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.107786ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
107162024-11-14T04:56:15.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107172024-11-14T04:56:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107182024-11-14T04:56:15.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107192024-11-14T04:56:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107202024-11-14T04:56:15.315ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.902618ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
107212024-11-14T04:56:15.318ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107222024-11-14T04:56:15.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107232024-11-14T04:56:15.319ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:46:15.306802458 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
107242024-11-14T04:56:15.319ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.815351ms iteration = 11 status = {"expiration":"2024-11-14T04:46:15.306802458Z","pruned":[]}
107252024-11-14T04:56:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107262024-11-14T04:56:15.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107272024-11-14T04:56:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107282024-11-14T04:56:15.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107292024-11-14T04:56:15.320ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107302024-11-14T04:56:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107312024-11-14T04:56:15.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107322024-11-14T04:56:15.323ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 99977899 } })
107332024-11-14T04:56:15.323ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
107342024-11-14T04:56:15.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
107352024-11-14T04:56:15.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107362024-11-14T04:56:15.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107372024-11-14T04:56:15.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107382024-11-14T04:56:15.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107392024-11-14T04:56:15.336ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107402024-11-14T04:56:15.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107412024-11-14T04:56:15.338ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107422024-11-14T04:56:15.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107432024-11-14T04:56:15.341ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107442024-11-14T04:56:15.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107452024-11-14T04:56:15.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107462024-11-14T04:56:15.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107472024-11-14T04:56:15.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107482024-11-14T04:56:15.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107492024-11-14T04:56:15.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1554, tv_nsec: 127738103 } })
107502024-11-14T04:56:15.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
107512024-11-14T04:56:15.358ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107522024-11-14T04:56:15.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
107532024-11-14T04:56:15.362ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107542024-11-14T04:56:15.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107552024-11-14T04:56:15.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107562024-11-14T04:56:15.372ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107572024-11-14T04:56:15.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
107582024-11-14T04:56:15.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107592024-11-14T04:56:15.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107602024-11-14T04:56:15.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107612024-11-14T04:56:15.374ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107622024-11-14T04:56:15.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107632024-11-14T04:56:15.377ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107642024-11-14T04:56:15.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107652024-11-14T04:56:15.381ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107662024-11-14T04:56:15.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107672024-11-14T04:56:15.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107682024-11-14T04:56:15.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107692024-11-14T04:56:15.388ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
107702024-11-14T04:56:15.388ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 82.006775ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
107712024-11-14T04:56:15.397ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107722024-11-14T04:56:15.397ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107732024-11-14T04:56:15.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107742024-11-14T04:56:15.397ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
107752024-11-14T04:56:15.397ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
107762024-11-14T04:56:15.397ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.345927ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
107772024-11-14T04:56:15.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107782024-11-14T04:56:15.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107792024-11-14T04:56:15.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107802024-11-14T04:56:15.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107812024-11-14T04:56:15.398ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107822024-11-14T04:56:15.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107832024-11-14T04:56:15.400ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107842024-11-14T04:56:15.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
107852024-11-14T04:56:15.400ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107862024-11-14T04:56:15.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107872024-11-14T04:56:15.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
107882024-11-14T04:56:15.403ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
107892024-11-14T04:56:15.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
107902024-11-14T04:56:15.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107912024-11-14T04:56:15.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107922024-11-14T04:56:15.412ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 105.282239ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
107932024-11-14T04:56:15.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.490484ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107942024-11-14T04:56:15.416ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107952024-11-14T04:56:15.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107962024-11-14T04:56:15.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107972024-11-14T04:56:15.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107982024-11-14T04:56:15.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107992024-11-14T04:56:15.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108002024-11-14T04:56:15.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108012024-11-14T04:56:15.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108022024-11-14T04:56:15.428ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108032024-11-14T04:56:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108042024-11-14T04:56:15.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108052024-11-14T04:56:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108062024-11-14T04:56:15.430ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 123.809085ms iteration = 23 status = {"physical_disks_added":0}
108072024-11-14T04:56:15.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108082024-11-14T04:56:15.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108092024-11-14T04:56:15.433ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108102024-11-14T04:56:15.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108112024-11-14T04:56:15.435ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
108122024-11-14T04:56:15.435ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 128.81306ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
108132024-11-14T04:56:15.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 129.015727ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108142024-11-14T04:56:15.452ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108152024-11-14T04:56:15.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108162024-11-14T04:56:15.453ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108172024-11-14T04:56:15.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108182024-11-14T04:56:15.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108192024-11-14T04:56:15.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108202024-11-14T04:56:15.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108212024-11-14T04:56:15.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108222024-11-14T04:56:15.475ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108232024-11-14T04:56:15.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108242024-11-14T04:56:15.481ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108252024-11-14T04:56:15.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108262024-11-14T04:56:15.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
108272024-11-14T04:56:15.490ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108282024-11-14T04:56:15.491ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108292024-11-14T04:56:15.491ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
108302024-11-14T04:56:15.491ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108312024-11-14T04:56:15.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
108322024-11-14T04:56:15.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108332024-11-14T04:56:15.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108342024-11-14T04:56:15.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 186.330436ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
108352024-11-14T04:56:15.494ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
108362024-11-14T04:56:15.494ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 187.664334ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
108372024-11-14T04:56:15.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 188.289953ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
108382024-11-14T04:56:15.495ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
108392024-11-14T04:56:15.495ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
108402024-11-14T04:56:15.495ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
108412024-11-14T04:56:15.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108422024-11-14T04:56:15.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108432024-11-14T04:56:15.496ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
108442024-11-14T04:56:15.496ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
108452024-11-14T04:56:15.496ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 189.458597ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
108462024-11-14T04:56:15.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108472024-11-14T04:56:15.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108482024-11-14T04:56:15.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108492024-11-14T04:56:15.502ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
108502024-11-14T04:56:15.502ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
108512024-11-14T04:56:15.502ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
108522024-11-14T04:56:15.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108532024-11-14T04:56:15.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108542024-11-14T04:56:15.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108552024-11-14T04:56:15.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108562024-11-14T04:56:15.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108572024-11-14T04:56:15.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108582024-11-14T04:56:15.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108592024-11-14T04:56:15.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108602024-11-14T04:56:15.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108612024-11-14T04:56:15.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108622024-11-14T04:56:15.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108632024-11-14T04:56:15.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108642024-11-14T04:56:15.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
108652024-11-14T04:56:15.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108662024-11-14T04:56:15.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108672024-11-14T04:56:15.516ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
108682024-11-14T04:56:15.516ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108692024-11-14T04:56:15.516ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "818e51db-72b4-409f-898b-17583db31bf9", "content-length": "26", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
108702024-11-14T04:56:15.516ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108712024-11-14T04:56:15.518ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108722024-11-14T04:56:15.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108732024-11-14T04:56:15.521ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108742024-11-14T04:56:15.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108752024-11-14T04:56:15.522ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
108762024-11-14T04:56:15.522ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
108772024-11-14T04:56:15.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108782024-11-14T04:56:15.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108792024-11-14T04:56:15.525ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108802024-11-14T04:56:15.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
108812024-11-14T04:56:15.529ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108822024-11-14T04:56:15.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108832024-11-14T04:56:15.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
108842024-11-14T04:56:15.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108852024-11-14T04:56:15.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108862024-11-14T04:56:15.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108872024-11-14T04:56:15.531ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108882024-11-14T04:56:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108892024-11-14T04:56:15.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108902024-11-14T04:56:15.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108912024-11-14T04:56:15.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108922024-11-14T04:56:15.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108932024-11-14T04:56:15.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108942024-11-14T04:56:15.541ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
108952024-11-14T04:56:15.541ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
108962024-11-14T04:56:15.541ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
108972024-11-14T04:56:15.541ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 234.637425ms iteration = 11 status = {"generation":1}
108982024-11-14T04:56:15.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108992024-11-14T04:56:15.546ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
109002024-11-14T04:56:15.547ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109012024-11-14T04:56:15.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109022024-11-14T04:56:15.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
109032024-11-14T04:56:15.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109042024-11-14T04:56:15.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109052024-11-14T04:56:15.551ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109062024-11-14T04:56:15.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109072024-11-14T04:56:15.552ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109082024-11-14T04:56:15.554ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 247.331712ms iteration = 21 status = 0
109092024-11-14T04:56:15.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
109102024-11-14T04:56:15.555ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109112024-11-14T04:56:15.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109122024-11-14T04:56:15.564ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109132024-11-14T04:56:15.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109142024-11-14T04:56:15.572ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109152024-11-14T04:56:15.573ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
109162024-11-14T04:56:15.573ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 266.180108ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
109172024-11-14T04:56:15.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109182024-11-14T04:56:15.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109192024-11-14T04:56:15.587ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
109202024-11-14T04:56:15.587ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
109212024-11-14T04:56:15.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109222024-11-14T04:56:15.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109232024-11-14T04:56:15.633ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
109242024-11-14T04:56:15.637ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
109252024-11-14T04:56:15.637ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 330.46139ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
109262024-11-14T04:56:15.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
109272024-11-14T04:56:15.641ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109282024-11-14T04:56:15.642ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43fc662f-3a7f-41a4-86b9-38859bd54271", "content-length": "26", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
109292024-11-14T04:56:15.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109302024-11-14T04:56:15.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
109312024-11-14T04:56:15.658ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
109322024-11-14T04:56:15.658ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109332024-11-14T04:56:15.658ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5985cd43-5bf9-4e05-9103-d72a61773376", "content-length": "26", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
109342024-11-14T04:56:15.658ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109352024-11-14T04:56:15.661ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109362024-11-14T04:56:15.676ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
109372024-11-14T04:56:15.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 369.247663ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
109382024-11-14T04:56:15.697ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109392024-11-14T04:56:15.697ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109402024-11-14T04:56:15.698ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "96866aef-1332-485c-8ec3-f2a385da5264", "content-length": "372", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
109412024-11-14T04:56:15.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109422024-11-14T04:56:15.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109432024-11-14T04:56:15.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109442024-11-14T04:56:15.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109452024-11-14T04:56:15.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109462024-11-14T04:56:15.701ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109472024-11-14T04:56:15.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
109482024-11-14T04:56:15.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109492024-11-14T04:56:15.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109502024-11-14T04:56:15.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109512024-11-14T04:56:15.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109522024-11-14T04:56:15.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109532024-11-14T04:56:15.708ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
109542024-11-14T04:56:15.708ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
109552024-11-14T04:56:15.708ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
109562024-11-14T04:56:15.708ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 401.629111ms iteration = 11 status = {"generation":2}
109572024-11-14T04:56:15.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109582024-11-14T04:56:15.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109592024-11-14T04:56:15.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109602024-11-14T04:56:15.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109612024-11-14T04:56:15.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109622024-11-14T04:56:15.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109632024-11-14T04:56:15.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109642024-11-14T04:56:15.713ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109652024-11-14T04:56:15.716ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
109662024-11-14T04:56:15.716ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109672024-11-14T04:56:15.716ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bf5b1594-5b47-4437-a2b5-5a577346adab", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
109682024-11-14T04:56:15.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109692024-11-14T04:56:15.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109702024-11-14T04:56:15.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109712024-11-14T04:56:15.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109722024-11-14T04:56:15.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109732024-11-14T04:56:15.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
109742024-11-14T04:56:15.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109752024-11-14T04:56:15.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109762024-11-14T04:56:15.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109772024-11-14T04:56:15.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109782024-11-14T04:56:15.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109792024-11-14T04:56:15.723ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
109802024-11-14T04:56:15.723ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109812024-11-14T04:56:15.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109822024-11-14T04:56:15.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109832024-11-14T04:56:15.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109842024-11-14T04:56:15.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109852024-11-14T04:56:15.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109862024-11-14T04:56:15.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109872024-11-14T04:56:15.729ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109882024-11-14T04:56:15.729ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109892024-11-14T04:56:15.729ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "959106fd-f43d-4677-b428-2698c829563c", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
109902024-11-14T04:56:15.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109912024-11-14T04:56:15.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109922024-11-14T04:56:15.731ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 424.689379ms iteration = 21 status = {}
109932024-11-14T04:56:15.733ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109942024-11-14T04:56:15.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109952024-11-14T04:56:15.735ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109962024-11-14T04:56:15.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109972024-11-14T04:56:15.753ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 446.5058ms iteration = 21 status = {}
109982024-11-14T04:56:15.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
109992024-11-14T04:56:15.804ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "06b1d77a-56c7-4803-9955-561d4b03f2d2", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110002024-11-14T04:56:15.804ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110012024-11-14T04:56:15.807ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3e4f743c-5882-4e84-9c3f-ff2e219d49c3", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110022024-11-14T04:56:15.807ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110032024-11-14T04:56:15.807ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
110042024-11-14T04:56:15.807ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd180a81-1b2f-47ec-8c22-29a5a2851769", "content-length": "1", "date": "Thu, 14 Nov 2024 04:56:14 GMT"} })
110052024-11-14T04:56:15.814ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
110062024-11-14T04:56:15.814ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 507.958159ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
110072024-11-14T04:56:15.815ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110082024-11-14T04:56:15.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110092024-11-14T04:56:15.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 1c62675c-b482-47bd-ba00-c84cb1bac1f9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
110102024-11-14T04:56:15.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 1c62675c-b482-47bd-ba00-c84cb1bac1f9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
110112024-11-14T04:56:15.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 631f2f54-1582-4d3e-a552-e04cff9404f1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
110122024-11-14T04:56:15.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 631f2f54-1582-4d3e-a552-e04cff9404f1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
110132024-11-14T04:56:15.851ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
110142024-11-14T04:56:15.851ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3886c21c-e580-42a5-85e7-b94114e9d2d9", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110152024-11-14T04:56:15.851ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110162024-11-14T04:56:15.854ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "29dcad60-275e-4683-b2aa-88eeca717a51", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110172024-11-14T04:56:15.854ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110182024-11-14T04:56:15.856ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
110192024-11-14T04:56:15.856ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fc665fd8-4dde-4333-b58b-8d0a1998350e", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110202024-11-14T04:56:15.856ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110212024-11-14T04:56:15.856ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0ec1ec4-2618-499f-93c8-e7aab135b204", "content-length": "691", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
110222024-11-14T04:56:15.856ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
110232024-11-14T04:56:15.856ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
110242024-11-14T04:56:15.856ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
110252024-11-14T04:56:15.858ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 551.778199ms iteration = 21 status = null
110262024-11-14T04:56:15.858ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 552.114998ms iteration = 21 status = {}
110272024-11-14T04:56:15.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110282024-11-14T04:56:15.859ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
110292024-11-14T04:56:15.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 552.964393ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
110302024-11-14T04:56:15.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 631f2f54-1582-4d3e-a552-e04cff9404f1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
110312024-11-14T04:56:15.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110322024-11-14T04:56:15.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 1c62675c-b482-47bd-ba00-c84cb1bac1f9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
110332024-11-14T04:56:15.861ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110342024-11-14T04:56:15.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110352024-11-14T04:56:15.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110362024-11-14T04:56:15.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110372024-11-14T04:56:15.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110382024-11-14T04:56:15.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
110392024-11-14T04:56:15.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110402024-11-14T04:56:15.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110412024-11-14T04:56:15.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110422024-11-14T04:56:15.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110432024-11-14T04:56:15.872ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110442024-11-14T04:56:15.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110452024-11-14T04:56:15.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110462024-11-14T04:56:15.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
110472024-11-14T04:56:15.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110482024-11-14T04:56:15.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110492024-11-14T04:56:15.886ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 68cb12a7-f65f-4940-ad7a-12ac0e8fa220, kind: Service { id: 7d1b51fe-adf1-4350-9c25-9240054e3911 }, name: Name("nexus-7d1b51fe-adf1-4350-9c25-9240054e3911"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5946ca8-a389-4a86-aed2-97d4e8639c67, kind: Service { id: 13db289d-f9b6-41e9-b3bd-5ab4f3105694 }, name: Name("nexus-13db289d-f9b6-41e9-b3bd-5ab4f3105694"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b897d57d-b436-467c-89e9-441e43e441fa, kind: Service { id: 79994e02-6747-4071-83af-7872b31640fb }, name: Name("nexus-79994e02-6747-4071-83af-7872b31640fb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 32de9250-63c9-46be-9a6b-ee4af19ab1ab, kind: Service { id: 48221b8a-d832-4d05-ae47-e92f81388c0c }, name: Name("external-dns-48221b8a-d832-4d05-ae47-e92f81388c0c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 126])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da2f10b4-11b4-4931-a7f7-d415353256ec, kind: Service { id: 8c0d54f6-76b3-47cc-9828-b8e677cc2961 }, name: Name("external-dns-8c0d54f6-76b3-47cc-9828-b8e677cc2961"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
110502024-11-14T04:56:15.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110512024-11-14T04:56:15.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110522024-11-14T04:56:15.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110532024-11-14T04:56:15.890ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
110542024-11-14T04:56:15.890ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110552024-11-14T04:56:15.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110562024-11-14T04:56:15.892ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
110572024-11-14T04:56:15.892ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32de9250-63c9-46be-9a6b-ee4af19ab1ab, kind: Service { id: 48221b8a-d832-4d05-ae47-e92f81388c0c }, name: Name("external-dns-48221b8a-d832-4d05-ae47-e92f81388c0c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 126])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: da2f10b4-11b4-4931-a7f7-d415353256ec, kind: Service { id: 8c0d54f6-76b3-47cc-9828-b8e677cc2961 }, name: Name("external-dns-8c0d54f6-76b3-47cc-9828-b8e677cc2961"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 129])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 68cb12a7-f65f-4940-ad7a-12ac0e8fa220, kind: Service { id: 7d1b51fe-adf1-4350-9c25-9240054e3911 }, name: Name("nexus-7d1b51fe-adf1-4350-9c25-9240054e3911"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5946ca8-a389-4a86-aed2-97d4e8639c67, kind: Service { id: 13db289d-f9b6-41e9-b3bd-5ab4f3105694 }, name: Name("nexus-13db289d-f9b6-41e9-b3bd-5ab4f3105694"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b897d57d-b436-467c-89e9-441e43e441fa, kind: Service { id: 79994e02-6747-4071-83af-7872b31640fb }, name: Name("nexus-79994e02-6747-4071-83af-7872b31640fb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 66])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
110582024-11-14T04:56:15.892ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
110592024-11-14T04:56:15.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110602024-11-14T04:56:15.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110612024-11-14T04:56:15.926ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
110622024-11-14T04:56:15.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110632024-11-14T04:56:15.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110642024-11-14T04:56:15.938ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
110652024-11-14T04:56:15.939ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "25a45a9d-e92d-4688-b6db-a844617768ca", "content-length": "134", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
110662024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
110672024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
110682024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
110692024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
110702024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110712024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110722024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110732024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110742024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
110752024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
110762024-11-14T04:56:15.939ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
110772024-11-14T04:56:15.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110782024-11-14T04:56:15.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110792024-11-14T04:56:15.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
110802024-11-14T04:56:15.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4da82afd-033a-4206-bc25-bb2074cfbf98", "content-length": "2", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
110812024-11-14T04:56:15.943ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
110822024-11-14T04:56:15.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "df30de23-74f3-4924-ac94-a4d57ceaa3b9", "content-length": "51", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
110832024-11-14T04:56:15.943ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
110842024-11-14T04:56:15.943ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
110852024-11-14T04:56:15.957ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c073d51c-abaa-48df-abb6-2f053e9c1bec, time_created: 2024-11-14T04:46:13.572725Z, time_modified: 2024-11-14T04:46:13.572725Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f971eb12-0fea-4084-96d3-74198bddd289, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
110862024-11-14T04:56:15.957ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
110872024-11-14T04:56:15.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110882024-11-14T04:56:15.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110892024-11-14T04:56:15.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110902024-11-14T04:56:15.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110912024-11-14T04:56:15.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110922024-11-14T04:56:15.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
110932024-11-14T04:56:16.000ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
110942024-11-14T04:56:16.069ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cf55fe4b-447e-4782-9150-a59cb8a4900e", "date": "Thu, 14 Nov 2024 04:56:15 GMT"} })
110952024-11-14T04:56:16.069ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
110962024-11-14T04:56:16.069ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110972024-11-14T04:56:16.069ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "14174edb-0450-4f16-8ca7-4fd5c36614ad", "content-length": "682", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
110982024-11-14T04:56:16.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110992024-11-14T04:56:16.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111002024-11-14T04:56:16.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111012024-11-14T04:56:16.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111022024-11-14T04:56:16.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111032024-11-14T04:56:16.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111042024-11-14T04:56:16.078ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "cb9e77a9-657f-4bdc-89f5-0a76e842f6b7", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111052024-11-14T04:56:16.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111062024-11-14T04:56:16.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111072024-11-14T04:56:16.080ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
111082024-11-14T04:56:16.080ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 773.599492ms
111092024-11-14T04:56:16.080ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 773.610643ms iteration = 3 status = {}
111102024-11-14T04:56:16.086ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 779.516354ms iteration = 21 status = {}
111112024-11-14T04:56:16.822ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
111122024-11-14T04:56:16.822ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111132024-11-14T04:56:16.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111142024-11-14T04:56:16.824ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111152024-11-14T04:56:16.826ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
111162024-11-14T04:56:16.826ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111172024-11-14T04:56:16.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111182024-11-14T04:56:16.837ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(600ec60a-2dd6-472c-b285-024765cf6c90, 0), (5f2ddd08-a8e8-4775-819d-824daf062f34, 0), (677476f2-8740-4b58-93e4-82e4fac86fd6, 0), (d95ae763-8d86-4bd5-abd2-194094308449, 0)] collection_id = 600ec60a-2dd6-472c-b285-024765cf6c90
111192024-11-14T04:56:16.838ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111202024-11-14T04:56:16.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111212024-11-14T04:56:16.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a1643e5e-496b-4dbe-bb88-2e391fa33e42 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
111222024-11-14T04:56:16.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a1643e5e-496b-4dbe-bb88-2e391fa33e42 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
111232024-11-14T04:56:16.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a1643e5e-496b-4dbe-bb88-2e391fa33e42 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
111242024-11-14T04:56:16.921ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 600ec60a-2dd6-472c-b285-024765cf6c90 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
111252024-11-14T04:56:16.921ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111262024-11-14T04:56:16.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111272024-11-14T04:56:16.924ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(5f2ddd08-a8e8-4775-819d-824daf062f34, 0), (677476f2-8740-4b58-93e4-82e4fac86fd6, 0), (d95ae763-8d86-4bd5-abd2-194094308449, 0), (ecb3f7af-d2d2-4097-9125-aa9cff7e1e2d, 0)] collection_id = 5f2ddd08-a8e8-4775-819d-824daf062f34
111282024-11-14T04:56:16.924ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111292024-11-14T04:56:16.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111302024-11-14T04:56:16.981ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 5f2ddd08-a8e8-4775-819d-824daf062f34 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
111312024-11-14T04:56:16.981ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111322024-11-14T04:56:16.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111332024-11-14T04:56:16.985ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(677476f2-8740-4b58-93e4-82e4fac86fd6, 0), (d95ae763-8d86-4bd5-abd2-194094308449, 0), (ecb3f7af-d2d2-4097-9125-aa9cff7e1e2d, 0)]
111342024-11-14T04:56:16.986ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1555, tv_nsec: 762494903 } })
111352024-11-14T04:56:17.017ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
111362024-11-14T04:56:17.017ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
111372024-11-14T04:56:17.017ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
111382024-11-14T04:56:17.020ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "36b61986-2f94-445a-88c7-d9bbaf302759", "content-length": "476", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111392024-11-14T04:56:17.020ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
111402024-11-14T04:56:17.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "039dc426-4667-4702-8e94-384d333f12b8", "content-length": "734", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111412024-11-14T04:56:17.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
111422024-11-14T04:56:17.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "31d0ddd3-4bfa-4550-9105-4059e2060a03", "content-length": "111", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111432024-11-14T04:56:17.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
111442024-11-14T04:56:17.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae4afd16-e9bf-4a11-a147-342c364cd4a5", "content-length": "111", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111452024-11-14T04:56:17.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
111462024-11-14T04:56:17.021ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "043bdb49-58da-4b49-b26e-4ca6da50b338", "content-length": "167", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111472024-11-14T04:56:17.021ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
111482024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bb005d2-0219-42a6-b188-85fadd06512f", "content-length": "167", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111492024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
111502024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "82a7cddb-cebf-43d9-9780-ca4b6f8d148a", "content-length": "175", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111512024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
111522024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d17064c-0fa1-4e57-9ae8-19b86d1381a6", "content-length": "175", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111532024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
111542024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c012a13-9dda-4f7c-b38b-a2acc1a6ae1d", "content-length": "702", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111552024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
111562024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c4bd8ca-8ed2-4629-888e-504aa345b4a5", "content-length": "727", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111572024-11-14T04:56:17.022ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
111582024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2712fa25-1b19-411a-9e13-8d95568d4adc", "content-length": "729", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111592024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
111602024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3bce81c-5fcb-44f0-9e76-98114b5ce55f", "content-length": "728", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111612024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
111622024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "774af5cf-bee7-406d-ad07-a6b80eab6562", "content-length": "722", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111632024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
111642024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1567b23-f40b-40fc-898f-e7d953d9fc71", "content-length": "109", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111652024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
111662024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b900065-8dc2-4ec5-a8a7-fc72f09c98df", "content-length": "109", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111672024-11-14T04:56:17.023ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
111682024-11-14T04:56:17.024ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b8aad8c-7eed-4f33-9045-eb9c793ece34", "content-length": "169", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111692024-11-14T04:56:17.024ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
111702024-11-14T04:56:17.024ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6a05fe4-79ba-4091-ae39-dd6aa7e9d5d5", "content-length": "169", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111712024-11-14T04:56:17.024ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
111722024-11-14T04:56:17.024ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "49506407-d07f-4cc1-9f51-93e72013d571", "content-length": "178", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111732024-11-14T04:56:17.024ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
111742024-11-14T04:56:17.024ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0676948e-988f-40c4-a8ba-6a743d5c2c4c", "content-length": "178", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111752024-11-14T04:56:17.024ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
111762024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d405127-1875-425c-a3f0-4223e06e02c0", "content-length": "702", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111772024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111782024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "df11f902-5ed2-402f-bdc8-cf3afee656c1", "content-length": "727", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111792024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111802024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e10fdf6d-cc7d-4480-8c08-a4c3c000dcf7", "content-length": "729", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111812024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
111822024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8938b61-66ad-4058-8852-55ce60f19861", "content-length": "728", "date": "Thu, 14 Nov 2024 04:56:16 GMT"} })
111832024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111842024-11-14T04:56:17.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111852024-11-14T04:56:17.027ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111862024-11-14T04:56:17.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111872024-11-14T04:56:17.029ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111882024-11-14T04:56:17.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111892024-11-14T04:56:17.031ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111902024-11-14T04:56:17.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
111912024-11-14T04:56:17.033ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111922024-11-14T04:56:17.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111932024-11-14T04:56:17.066ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
111942024-11-14T04:56:17.066ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
111952024-11-14T04:56:17.275ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "c58e3a83-061f-4e51-a26e-c70089638174", "content-length": "30760", "date": "Thu, 14 Nov 2024 04:56:17 GMT"} })
111962024-11-14T04:56:17.277ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
111972024-11-14T04:56:17.277ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
111982024-11-14T04:56:17.277ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
111992024-11-14T04:56:17.278ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112002024-11-14T04:56:17.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112012024-11-14T04:56:17.280ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112022024-11-14T04:56:17.282ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
112032024-11-14T04:56:17.282ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112042024-11-14T04:56:17.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112052024-11-14T04:56:17.434ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = a8e474f3-aa9c-49e8-a43b-c0a024a691ec file = nexus/db-queries/src/db/datastore/inventory.rs:1000
112062024-11-14T04:56:17.434ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = a8e474f3-aa9c-49e8-a43b-c0a024a691ec time_started = 2024-11-14 04:56:17.017199 UTC
112072024-11-14T04:56:17.434ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 612.004143ms iteration = 3 status = {"collection_id":"a8e474f3-aa9c-49e8-a43b-c0a024a691ec","time_done":"2024-11-14 04:56:17.277054 UTC","time_started":"2024-11-14 04:56:17.017199 UTC"}
112082024-11-14T04:56:17.434ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
112092024-11-14T04:56:17.434ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112102024-11-14T04:56:17.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112112024-11-14T04:56:17.436ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112122024-11-14T04:56:17.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112132024-11-14T04:56:17.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112142024-11-14T04:56:17.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112152024-11-14T04:56:17.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112162024-11-14T04:56:17.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112172024-11-14T04:56:17.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112182024-11-14T04:56:17.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112192024-11-14T04:56:17.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112202024-11-14T04:56:17.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112212024-11-14T04:56:17.479ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 45.036134ms iteration = 24 status = {"physical_disks_added":0}
112222024-11-14T04:56:17.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 44df124e-2312-4c41-8747-0f3ddafdb667 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112232024-11-14T04:56:17.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 44df124e-2312-4c41-8747-0f3ddafdb667 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112242024-11-14T04:56:17.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 44df124e-2312-4c41-8747-0f3ddafdb667 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112252024-11-14T04:56:18.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 897b2fc5-781c-4c3b-b974-f9024c68fca2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112262024-11-14T04:56:18.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 897b2fc5-781c-4c3b-b974-f9024c68fca2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112272024-11-14T04:56:18.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 897b2fc5-781c-4c3b-b974-f9024c68fca2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112282024-11-14T04:56:19.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a0d3bc9-0cee-46b2-90d6-eb5f1fc6cee6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112292024-11-14T04:56:19.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a0d3bc9-0cee-46b2-90d6-eb5f1fc6cee6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112302024-11-14T04:56:19.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5a0d3bc9-0cee-46b2-90d6-eb5f1fc6cee6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112312024-11-14T04:56:20.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 547 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = e8cba3fb-6cbb-4d95-9824-c6262b4b91ba response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
112322024-11-14T04:56:20.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56d7ba46-2803-40a3-96e3-1e9e94ef1376 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112332024-11-14T04:56:20.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56d7ba46-2803-40a3-96e3-1e9e94ef1376 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112342024-11-14T04:56:20.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 56d7ba46-2803-40a3-96e3-1e9e94ef1376 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112352024-11-14T04:56:21.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 01ab13ca-f467-49dc-9b4f-afaa91509e52 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112362024-11-14T04:56:21.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 01ab13ca-f467-49dc-9b4f-afaa91509e52 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112372024-11-14T04:56:22.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 01ab13ca-f467-49dc-9b4f-afaa91509e52 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112382024-11-14T04:56:23.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d6d647e-f1f5-4aed-bd82-ebbc5d8ed69e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112392024-11-14T04:56:23.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d6d647e-f1f5-4aed-bd82-ebbc5d8ed69e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112402024-11-14T04:56:23.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9d6d647e-f1f5-4aed-bd82-ebbc5d8ed69e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112412024-11-14T04:56:24.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32bb028b-a858-410e-bb9e-2315275bc06a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112422024-11-14T04:56:24.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32bb028b-a858-410e-bb9e-2315275bc06a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112432024-11-14T04:56:24.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 32bb028b-a858-410e-bb9e-2315275bc06a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112442024-11-14T04:56:25.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 90ec0ac6-d065-436d-a70d-ec8345695a51 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112452024-11-14T04:56:25.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 90ec0ac6-d065-436d-a70d-ec8345695a51 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112462024-11-14T04:56:25.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 90ec0ac6-d065-436d-a70d-ec8345695a51 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112472024-11-14T04:56:25.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 2eb89482-4d3a-4341-8d13-3e89c388e729 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
112482024-11-14T04:56:25.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 2eb89482-4d3a-4341-8d13-3e89c388e729 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
112492024-11-14T04:56:25.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 2eb89482-4d3a-4341-8d13-3e89c388e729 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
112502024-11-14T04:56:25.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 82923a0a-30f3-41f1-857a-1007ef8f2791 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
112512024-11-14T04:56:25.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 82923a0a-30f3-41f1-857a-1007ef8f2791 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
112522024-11-14T04:56:25.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 82923a0a-30f3-41f1-857a-1007ef8f2791 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
112532024-11-14T04:56:25.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
112542024-11-14T04:56:25.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
112552024-11-14T04:56:25.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112562024-11-14T04:56:25.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112572024-11-14T04:56:25.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112582024-11-14T04:56:25.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112592024-11-14T04:56:25.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112602024-11-14T04:56:25.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112612024-11-14T04:56:25.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112622024-11-14T04:56:25.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.559703ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112632024-11-14T04:56:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112642024-11-14T04:56:25.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112652024-11-14T04:56:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112662024-11-14T04:56:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112672024-11-14T04:56:25.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112682024-11-14T04:56:25.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112692024-11-14T04:56:25.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
112702024-11-14T04:56:25.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112712024-11-14T04:56:25.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112722024-11-14T04:56:25.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
112732024-11-14T04:56:25.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.064817ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
112742024-11-14T04:56:26.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7bd06081-cace-4e36-8f45-2ff48c35ef7f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112752024-11-14T04:56:26.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7bd06081-cace-4e36-8f45-2ff48c35ef7f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112762024-11-14T04:56:26.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7bd06081-cace-4e36-8f45-2ff48c35ef7f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112772024-11-14T04:56:27.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2d65df0e-2d61-42ba-8630-4f450220baf0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112782024-11-14T04:56:27.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2d65df0e-2d61-42ba-8630-4f450220baf0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112792024-11-14T04:56:27.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2d65df0e-2d61-42ba-8630-4f450220baf0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112802024-11-14T04:56:28.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 298c03dc-a969-48a2-b39a-36db52a70594 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112812024-11-14T04:56:28.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 298c03dc-a969-48a2-b39a-36db52a70594 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112822024-11-14T04:56:28.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 298c03dc-a969-48a2-b39a-36db52a70594 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112832024-11-14T04:56:29.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be48f1f8-04bc-4f52-8828-1299241726cc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112842024-11-14T04:56:29.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be48f1f8-04bc-4f52-8828-1299241726cc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112852024-11-14T04:56:29.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be48f1f8-04bc-4f52-8828-1299241726cc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112862024-11-14T04:56:30.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7b6752d0-6d70-4c39-ad02-4f962ee03cca roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112872024-11-14T04:56:30.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7b6752d0-6d70-4c39-ad02-4f962ee03cca resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112882024-11-14T04:56:30.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7b6752d0-6d70-4c39-ad02-4f962ee03cca response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112892024-11-14T04:56:31.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef2dac31-ce60-4627-962d-a87813ebd09c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112902024-11-14T04:56:31.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef2dac31-ce60-4627-962d-a87813ebd09c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112912024-11-14T04:56:31.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ef2dac31-ce60-4627-962d-a87813ebd09c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112922024-11-14T04:56:32.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fcdfa628-09f2-4544-a389-cc634bc67c96 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112932024-11-14T04:56:32.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fcdfa628-09f2-4544-a389-cc634bc67c96 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112942024-11-14T04:56:32.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fcdfa628-09f2-4544-a389-cc634bc67c96 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112952024-11-14T04:56:33.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f1f9c241-9e8b-43cf-b8ac-faf23e2ffa93 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112962024-11-14T04:56:33.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f1f9c241-9e8b-43cf-b8ac-faf23e2ffa93 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112972024-11-14T04:56:33.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f1f9c241-9e8b-43cf-b8ac-faf23e2ffa93 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112982024-11-14T04:56:34.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 228e8ab2-ccc9-4a8a-b6dd-eac69879d47c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
112992024-11-14T04:56:34.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 228e8ab2-ccc9-4a8a-b6dd-eac69879d47c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113002024-11-14T04:56:34.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 228e8ab2-ccc9-4a8a-b6dd-eac69879d47c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113012024-11-14T04:56:35.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 854 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = cb01469c-4afe-4da6-bc29-1fccc5350ab7 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
113022024-11-14T04:56:35.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
113032024-11-14T04:56:35.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113042024-11-14T04:56:35.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
113052024-11-14T04:56:35.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113062024-11-14T04:56:35.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113072024-11-14T04:56:35.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113082024-11-14T04:56:35.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113092024-11-14T04:56:35.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113102024-11-14T04:56:35.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113112024-11-14T04:56:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113122024-11-14T04:56:35.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113132024-11-14T04:56:35.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.066558ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113142024-11-14T04:56:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113152024-11-14T04:56:35.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 16923e16-4be8-433d-bf6d-3312bad93a83 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113162024-11-14T04:56:35.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 16923e16-4be8-433d-bf6d-3312bad93a83 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113172024-11-14T04:56:35.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113182024-11-14T04:56:35.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 16923e16-4be8-433d-bf6d-3312bad93a83 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113192024-11-14T04:56:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113202024-11-14T04:56:35.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113212024-11-14T04:56:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
113222024-11-14T04:56:35.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113232024-11-14T04:56:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113242024-11-14T04:56:35.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
113252024-11-14T04:56:35.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.843621ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
113262024-11-14T04:56:36.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f1ed4f70-6211-416d-8705-dbcedc5ba147 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113272024-11-14T04:56:36.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f1ed4f70-6211-416d-8705-dbcedc5ba147 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113282024-11-14T04:56:36.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f1ed4f70-6211-416d-8705-dbcedc5ba147 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113292024-11-14T04:56:37.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8fa97fb-a17f-4c5c-9e7b-82295301440a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113302024-11-14T04:56:37.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8fa97fb-a17f-4c5c-9e7b-82295301440a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113312024-11-14T04:56:37.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b8fa97fb-a17f-4c5c-9e7b-82295301440a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113322024-11-14T04:56:38.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15a17853-353e-4103-b749-f817b0be3376 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113332024-11-14T04:56:38.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15a17853-353e-4103-b749-f817b0be3376 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113342024-11-14T04:56:38.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15a17853-353e-4103-b749-f817b0be3376 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113352024-11-14T04:56:39.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 14b5c851-67c5-4a74-8cdd-e61ca51719b5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113362024-11-14T04:56:39.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 14b5c851-67c5-4a74-8cdd-e61ca51719b5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113372024-11-14T04:56:39.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 14b5c851-67c5-4a74-8cdd-e61ca51719b5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113382024-11-14T04:56:40.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6b2f0c1-8515-48a6-9356-fac5047701cc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113392024-11-14T04:56:40.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6b2f0c1-8515-48a6-9356-fac5047701cc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113402024-11-14T04:56:40.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a6b2f0c1-8515-48a6-9356-fac5047701cc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113412024-11-14T04:56:41.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e77df044-d8dc-4ad1-9d95-818929132703 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113422024-11-14T04:56:41.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e77df044-d8dc-4ad1-9d95-818929132703 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113432024-11-14T04:56:41.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e77df044-d8dc-4ad1-9d95-818929132703 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113442024-11-14T04:56:42.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f78fbbf3-9bda-42f8-8fb5-3f0aa808f61b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113452024-11-14T04:56:42.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f78fbbf3-9bda-42f8-8fb5-3f0aa808f61b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113462024-11-14T04:56:42.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f78fbbf3-9bda-42f8-8fb5-3f0aa808f61b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113472024-11-14T04:56:43.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b1eeaae6-3187-4423-810e-77fa04bfe143 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113482024-11-14T04:56:43.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b1eeaae6-3187-4423-810e-77fa04bfe143 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113492024-11-14T04:56:43.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b1eeaae6-3187-4423-810e-77fa04bfe143 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113502024-11-14T04:56:44.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c66a3c65-6b35-4eac-95aa-da43ea635600 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113512024-11-14T04:56:44.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c66a3c65-6b35-4eac-95aa-da43ea635600 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113522024-11-14T04:56:44.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c66a3c65-6b35-4eac-95aa-da43ea635600 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
113532024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
113542024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113552024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
113562024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113572024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
113582024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
113592024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113602024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
113612024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
113622024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
113632024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
113642024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
113652024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
113662024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
113672024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113682024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
113692024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
113702024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
113712024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
113722024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113732024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
113742024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113752024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
113762024-11-14T04:56:45.305ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
113772024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113782024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
113792024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
113802024-11-14T04:56:45.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113812024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113822024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
113832024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
113842024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
113852024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113862024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
113872024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
113882024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113892024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
113902024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
113912024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113922024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
113932024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113942024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113952024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113962024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113972024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113982024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113992024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
114002024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114012024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114022024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114032024-11-14T04:56:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114042024-11-14T04:56:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114052024-11-14T04:56:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114062024-11-14T04:56:45.309ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 85898626 } })
114072024-11-14T04:56:45.309ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
114082024-11-14T04:56:45.309ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.309995ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
114092024-11-14T04:56:45.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114102024-11-14T04:56:45.310ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 87484192 } })
114112024-11-14T04:56:45.311ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
114122024-11-14T04:56:45.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114132024-11-14T04:56:45.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114142024-11-14T04:56:45.313ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114152024-11-14T04:56:45.313ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114162024-11-14T04:56:45.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114172024-11-14T04:56:45.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114182024-11-14T04:56:45.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114192024-11-14T04:56:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114202024-11-14T04:56:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114212024-11-14T04:56:45.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.359281ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
114222024-11-14T04:56:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
114232024-11-14T04:56:45.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114242024-11-14T04:56:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114252024-11-14T04:56:45.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114262024-11-14T04:56:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114272024-11-14T04:56:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114282024-11-14T04:56:45.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114292024-11-14T04:56:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
114302024-11-14T04:56:45.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114312024-11-14T04:56:45.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114322024-11-14T04:56:45.317ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114332024-11-14T04:56:45.317ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114342024-11-14T04:56:45.318ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.605254ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114352024-11-14T04:56:45.318ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114362024-11-14T04:56:45.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114372024-11-14T04:56:45.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114382024-11-14T04:56:45.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
114392024-11-14T04:56:45.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114402024-11-14T04:56:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114412024-11-14T04:56:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114422024-11-14T04:56:45.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114432024-11-14T04:56:45.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114442024-11-14T04:56:45.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114452024-11-14T04:56:45.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114462024-11-14T04:56:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114472024-11-14T04:56:45.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114482024-11-14T04:56:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114492024-11-14T04:56:45.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114502024-11-14T04:56:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114512024-11-14T04:56:45.324ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1584, tv_nsec: 100843659 } })
114522024-11-14T04:56:45.324ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
114532024-11-14T04:56:45.325ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114542024-11-14T04:56:45.325ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114552024-11-14T04:56:45.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114562024-11-14T04:56:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
114572024-11-14T04:56:45.327ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114582024-11-14T04:56:45.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114592024-11-14T04:56:45.343ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.289209ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
114602024-11-14T04:56:45.350ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114612024-11-14T04:56:45.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114622024-11-14T04:56:45.352ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114632024-11-14T04:56:45.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114642024-11-14T04:56:45.378ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114652024-11-14T04:56:45.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114662024-11-14T04:56:45.379ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114672024-11-14T04:56:45.379ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
114682024-11-14T04:56:45.379ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114692024-11-14T04:56:45.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114702024-11-14T04:56:45.381ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114712024-11-14T04:56:45.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114722024-11-14T04:56:45.381ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
114732024-11-14T04:56:45.381ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.123524ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
114742024-11-14T04:56:45.403ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
114752024-11-14T04:56:45.403ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114762024-11-14T04:56:45.403ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32e2a780-5358-412c-bc28-2ea985842536", "content-length": "26", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
114772024-11-14T04:56:45.403ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114782024-11-14T04:56:45.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114792024-11-14T04:56:45.408ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
114802024-11-14T04:56:45.408ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114812024-11-14T04:56:45.408ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13655733-df53-4a7d-b658-9ea2ccb1fd6a", "content-length": "26", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
114822024-11-14T04:56:45.408ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114832024-11-14T04:56:45.410ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114842024-11-14T04:56:45.431ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
114852024-11-14T04:56:45.431ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114862024-11-14T04:56:45.432ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a7eb0ce-eca2-4e9a-8017-00432f1cce3d", "content-length": "26", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
114872024-11-14T04:56:45.432ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114882024-11-14T04:56:45.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
114892024-11-14T04:56:45.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114902024-11-14T04:56:45.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114912024-11-14T04:56:45.485ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114922024-11-14T04:56:45.485ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114932024-11-14T04:56:45.485ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9845a3c0-eaf1-47cb-93cf-ee00b3927dfd", "content-length": "372", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
114942024-11-14T04:56:45.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114952024-11-14T04:56:45.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114962024-11-14T04:56:45.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114972024-11-14T04:56:45.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114982024-11-14T04:56:45.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114992024-11-14T04:56:45.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115002024-11-14T04:56:45.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115012024-11-14T04:56:45.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115022024-11-14T04:56:45.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115032024-11-14T04:56:45.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115042024-11-14T04:56:45.494ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115052024-11-14T04:56:45.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115062024-11-14T04:56:45.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115072024-11-14T04:56:45.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
115082024-11-14T04:56:45.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115092024-11-14T04:56:45.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115102024-11-14T04:56:45.498ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 192.633629ms iteration = 22 status = 0
115112024-11-14T04:56:45.500ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
115122024-11-14T04:56:45.500ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 195.025378ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
115132024-11-14T04:56:45.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 212.283898ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
115142024-11-14T04:56:45.519ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115152024-11-14T04:56:45.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115162024-11-14T04:56:45.528ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115172024-11-14T04:56:45.528ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
115182024-11-14T04:56:45.528ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 222.891105ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
115192024-11-14T04:56:45.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 228.220999ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
115202024-11-14T04:56:45.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 284b6a9f-7e2c-4374-887f-afc5057a7486 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
115212024-11-14T04:56:45.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115222024-11-14T04:56:45.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 284b6a9f-7e2c-4374-887f-afc5057a7486 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
115232024-11-14T04:56:45.541ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.556942ms iteration = 22 status = {}
115242024-11-14T04:56:45.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115252024-11-14T04:56:45.541ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115262024-11-14T04:56:45.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115272024-11-14T04:56:45.542ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
115282024-11-14T04:56:45.542ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115292024-11-14T04:56:45.542ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e4c8d248-b090-48e0-80ba-3bef9c778b9e", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115302024-11-14T04:56:45.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115312024-11-14T04:56:45.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115322024-11-14T04:56:45.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 284b6a9f-7e2c-4374-887f-afc5057a7486 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
115332024-11-14T04:56:45.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115342024-11-14T04:56:45.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115352024-11-14T04:56:45.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115362024-11-14T04:56:45.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 244.797529ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
115372024-11-14T04:56:45.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115382024-11-14T04:56:45.556ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115392024-11-14T04:56:45.556ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115402024-11-14T04:56:45.556ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "438bdac1-ab6f-45f3-8a33-c100d65ad43f", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115412024-11-14T04:56:45.559ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.555393ms iteration = 22 status = {}
115422024-11-14T04:56:45.593ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
115432024-11-14T04:56:45.593ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3bbda05-d004-482e-ba5b-26572c2a5270", "content-length": "1", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115442024-11-14T04:56:45.595ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115452024-11-14T04:56:45.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115462024-11-14T04:56:45.597ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.033497ms iteration = 22 status = null
115472024-11-14T04:56:45.616ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 310.659966ms iteration = 25 status = {"physical_disks_added":0}
115482024-11-14T04:56:45.656ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115492024-11-14T04:56:45.657ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d8f90bf-2d5e-4f09-9506-0d1196dd572e", "content-length": "691", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115502024-11-14T04:56:45.657ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
115512024-11-14T04:56:45.657ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
115522024-11-14T04:56:45.657ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
115532024-11-14T04:56:45.659ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 354.093395ms iteration = 22 status = {}
115542024-11-14T04:56:45.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115552024-11-14T04:56:45.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115562024-11-14T04:56:45.665ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
115572024-11-14T04:56:45.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115582024-11-14T04:56:45.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115592024-11-14T04:56:45.675ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115602024-11-14T04:56:45.675ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "66400a33-4c5b-4b74-ad17-df0199878a83", "content-length": "134", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115612024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115622024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
115632024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115642024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115652024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115662024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115672024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115682024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115692024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115702024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115712024-11-14T04:56:45.675ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
115722024-11-14T04:56:45.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115732024-11-14T04:56:45.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115742024-11-14T04:56:45.677ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115752024-11-14T04:56:45.678ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "269be5ee-4d4f-4d78-befb-f0f2a3ea9bcf", "content-length": "2", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115762024-11-14T04:56:45.678ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115772024-11-14T04:56:45.678ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d69c77a7-d195-48ab-a5a4-3a39f356a090", "content-length": "51", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115782024-11-14T04:56:45.678ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
115792024-11-14T04:56:45.678ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115802024-11-14T04:56:45.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = dc54ddb5-b135-457d-be04-3bd7471c8e6d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
115812024-11-14T04:56:45.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = dc54ddb5-b135-457d-be04-3bd7471c8e6d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
115822024-11-14T04:56:45.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = dc54ddb5-b135-457d-be04-3bd7471c8e6d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
115832024-11-14T04:56:45.957ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7c223c95-f0c5-46c5-a341-51be0c4f34b8", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115842024-11-14T04:56:45.957ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
115852024-11-14T04:56:45.957ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115862024-11-14T04:56:45.957ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "715bb54d-4eae-41b6-9785-5cad7519d85f", "content-length": "682", "date": "Thu, 14 Nov 2024 04:56:45 GMT"} })
115872024-11-14T04:56:45.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115882024-11-14T04:56:45.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115892024-11-14T04:56:45.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115902024-11-14T04:56:45.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115912024-11-14T04:56:45.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115922024-11-14T04:56:45.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115932024-11-14T04:56:45.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115942024-11-14T04:56:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115952024-11-14T04:56:45.973ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 667.774617ms iteration = 22 status = {}
115962024-11-14T04:56:46.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 98d7abca-22b8-448c-847d-65bb8783be20 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
115972024-11-14T04:56:46.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 98d7abca-22b8-448c-847d-65bb8783be20 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
115982024-11-14T04:56:46.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 98d7abca-22b8-448c-847d-65bb8783be20 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
115992024-11-14T04:56:47.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 67068854-9dcf-411c-909f-dd5a3e27346b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116002024-11-14T04:56:47.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 67068854-9dcf-411c-909f-dd5a3e27346b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116012024-11-14T04:56:47.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 67068854-9dcf-411c-909f-dd5a3e27346b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116022024-11-14T04:56:48.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e59b5724-c16c-47fb-a3a1-d85a79dcebdb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116032024-11-14T04:56:48.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e59b5724-c16c-47fb-a3a1-d85a79dcebdb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116042024-11-14T04:56:48.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e59b5724-c16c-47fb-a3a1-d85a79dcebdb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116052024-11-14T04:56:49.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 06856b3e-85b1-47dd-8980-382a30de2158 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116062024-11-14T04:56:49.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 06856b3e-85b1-47dd-8980-382a30de2158 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116072024-11-14T04:56:49.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 06856b3e-85b1-47dd-8980-382a30de2158 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116082024-11-14T04:56:50.258ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = c43e9405-d4b4-44f9-a431-953821ecbf88 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
116092024-11-14T04:56:50.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d4b3894-5a37-47fb-84c5-f206a3aba37c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116102024-11-14T04:56:50.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d4b3894-5a37-47fb-84c5-f206a3aba37c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116112024-11-14T04:56:50.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6d4b3894-5a37-47fb-84c5-f206a3aba37c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116122024-11-14T04:56:51.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea37390b-898d-4fa4-b48a-bb3da90ab0a6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116132024-11-14T04:56:51.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea37390b-898d-4fa4-b48a-bb3da90ab0a6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116142024-11-14T04:56:51.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea37390b-898d-4fa4-b48a-bb3da90ab0a6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116152024-11-14T04:56:52.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e029fa6-5660-4a79-8b0e-9717810199b8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116162024-11-14T04:56:52.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e029fa6-5660-4a79-8b0e-9717810199b8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116172024-11-14T04:56:52.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e029fa6-5660-4a79-8b0e-9717810199b8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116182024-11-14T04:56:53.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1eb48040-9673-47d7-9e50-0907a78fc3c1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116192024-11-14T04:56:53.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1eb48040-9673-47d7-9e50-0907a78fc3c1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116202024-11-14T04:56:53.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1eb48040-9673-47d7-9e50-0907a78fc3c1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116212024-11-14T04:56:54.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5f471b43-05be-4318-ab9c-0f4cdea78a18 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116222024-11-14T04:56:54.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5f471b43-05be-4318-ab9c-0f4cdea78a18 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116232024-11-14T04:56:54.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5f471b43-05be-4318-ab9c-0f4cdea78a18 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116242024-11-14T04:56:55.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
116252024-11-14T04:56:55.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116262024-11-14T04:56:55.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
116272024-11-14T04:56:55.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116282024-11-14T04:56:55.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116292024-11-14T04:56:55.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116302024-11-14T04:56:55.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116312024-11-14T04:56:55.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116322024-11-14T04:56:55.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116332024-11-14T04:56:55.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116342024-11-14T04:56:55.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116352024-11-14T04:56:55.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116362024-11-14T04:56:55.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116372024-11-14T04:56:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
116382024-11-14T04:56:55.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116392024-11-14T04:56:55.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116402024-11-14T04:56:55.330ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
116412024-11-14T04:56:55.330ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.180599ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
116422024-11-14T04:56:55.339ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116432024-11-14T04:56:55.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116442024-11-14T04:56:55.368ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.86733ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116452024-11-14T04:56:55.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fd43d02-0d72-4f53-8a32-a3f7eb997570 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116462024-11-14T04:56:55.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fd43d02-0d72-4f53-8a32-a3f7eb997570 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116472024-11-14T04:56:55.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5fd43d02-0d72-4f53-8a32-a3f7eb997570 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116482024-11-14T04:56:56.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 770f6bc3-96c5-4727-ac1c-d0f716430098 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116492024-11-14T04:56:56.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 770f6bc3-96c5-4727-ac1c-d0f716430098 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116502024-11-14T04:56:56.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 770f6bc3-96c5-4727-ac1c-d0f716430098 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116512024-11-14T04:56:57.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2a95a2c6-2fc6-4194-8af2-cd08b97c69b9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116522024-11-14T04:56:57.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2a95a2c6-2fc6-4194-8af2-cd08b97c69b9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116532024-11-14T04:56:57.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2a95a2c6-2fc6-4194-8af2-cd08b97c69b9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116542024-11-14T04:56:58.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a48c297d-3bf5-497b-9077-5478345ef362 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116552024-11-14T04:56:58.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a48c297d-3bf5-497b-9077-5478345ef362 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116562024-11-14T04:56:58.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a48c297d-3bf5-497b-9077-5478345ef362 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116572024-11-14T04:56:59.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9eb591a-5d00-447a-82ed-b7fed88e9e89 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116582024-11-14T04:56:59.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9eb591a-5d00-447a-82ed-b7fed88e9e89 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116592024-11-14T04:56:59.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d9eb591a-5d00-447a-82ed-b7fed88e9e89 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116602024-11-14T04:57:00.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1f44b8f-161b-4827-be04-7fcc38500e55 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116612024-11-14T04:57:00.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1f44b8f-161b-4827-be04-7fcc38500e55 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116622024-11-14T04:57:00.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1f44b8f-161b-4827-be04-7fcc38500e55 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116632024-11-14T04:57:01.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6cb89c32-8b2a-4fe2-b6a6-5ea66c5d7a2a roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116642024-11-14T04:57:01.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6cb89c32-8b2a-4fe2-b6a6-5ea66c5d7a2a resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116652024-11-14T04:57:01.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6cb89c32-8b2a-4fe2-b6a6-5ea66c5d7a2a response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116662024-11-14T04:57:02.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 10479e3f-9297-47d1-8e3b-b7a1d0361789 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116672024-11-14T04:57:02.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 10479e3f-9297-47d1-8e3b-b7a1d0361789 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116682024-11-14T04:57:02.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 10479e3f-9297-47d1-8e3b-b7a1d0361789 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116692024-11-14T04:57:03.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f5c3a97-c583-42c4-8f03-a8254ce35d8e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116702024-11-14T04:57:03.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f5c3a97-c583-42c4-8f03-a8254ce35d8e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116712024-11-14T04:57:03.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7f5c3a97-c583-42c4-8f03-a8254ce35d8e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116722024-11-14T04:57:04.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 31f06224-2467-47f6-aaae-74e609819304 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116732024-11-14T04:57:04.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 31f06224-2467-47f6-aaae-74e609819304 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116742024-11-14T04:57:04.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 31f06224-2467-47f6-aaae-74e609819304 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116752024-11-14T04:57:05.258ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 978e26f8-3f91-41e0-b892-cbc3f67009a0 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
116762024-11-14T04:57:05.306ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
116772024-11-14T04:57:05.306ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116782024-11-14T04:57:05.306ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
116792024-11-14T04:57:05.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116802024-11-14T04:57:05.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116812024-11-14T04:57:05.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116822024-11-14T04:57:05.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116832024-11-14T04:57:05.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116842024-11-14T04:57:05.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116852024-11-14T04:57:05.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116862024-11-14T04:57:05.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116872024-11-14T04:57:05.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116882024-11-14T04:57:05.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116892024-11-14T04:57:05.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
116902024-11-14T04:57:05.317ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116912024-11-14T04:57:05.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116922024-11-14T04:57:05.325ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
116932024-11-14T04:57:05.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.462754ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
116942024-11-14T04:57:05.336ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116952024-11-14T04:57:05.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116962024-11-14T04:57:05.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.321562ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116972024-11-14T04:57:06.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5e8cc59-dd64-4505-8040-ded4e448b172 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116982024-11-14T04:57:06.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5e8cc59-dd64-4505-8040-ded4e448b172 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
116992024-11-14T04:57:06.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a5e8cc59-dd64-4505-8040-ded4e448b172 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117002024-11-14T04:57:07.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f12b825f-7789-42cd-9823-6ac1d44d8645 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117012024-11-14T04:57:07.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f12b825f-7789-42cd-9823-6ac1d44d8645 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117022024-11-14T04:57:07.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f12b825f-7789-42cd-9823-6ac1d44d8645 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117032024-11-14T04:57:08.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ffc30b59-0549-47b8-87c1-70d1e7a45c09 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117042024-11-14T04:57:08.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ffc30b59-0549-47b8-87c1-70d1e7a45c09 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117052024-11-14T04:57:08.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ffc30b59-0549-47b8-87c1-70d1e7a45c09 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117062024-11-14T04:57:09.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5deeb7b1-82cd-4216-912e-7438a12fea11 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117072024-11-14T04:57:09.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5deeb7b1-82cd-4216-912e-7438a12fea11 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117082024-11-14T04:57:09.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5deeb7b1-82cd-4216-912e-7438a12fea11 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117092024-11-14T04:57:10.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 97f20244-56ae-4506-b190-835762645d11 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117102024-11-14T04:57:10.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 97f20244-56ae-4506-b190-835762645d11 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117112024-11-14T04:57:10.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 97f20244-56ae-4506-b190-835762645d11 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117122024-11-14T04:57:10.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = e0fb8218-ae16-44fe-b32f-692e8105532a roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
117132024-11-14T04:57:10.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = e0fb8218-ae16-44fe-b32f-692e8105532a resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
117142024-11-14T04:57:10.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = e0fb8218-ae16-44fe-b32f-692e8105532a response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
117152024-11-14T04:57:10.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 2cf3f4f4-8d0e-4b64-ad0f-46827d2731e9 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
117162024-11-14T04:57:10.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 2cf3f4f4-8d0e-4b64-ad0f-46827d2731e9 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
117172024-11-14T04:57:10.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 2cf3f4f4-8d0e-4b64-ad0f-46827d2731e9 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
117182024-11-14T04:57:11.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33608511-dde6-46b4-b9da-cbc9c46f9cb3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117192024-11-14T04:57:11.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33608511-dde6-46b4-b9da-cbc9c46f9cb3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117202024-11-14T04:57:11.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 33608511-dde6-46b4-b9da-cbc9c46f9cb3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117212024-11-14T04:57:12.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6efa98b2-4f91-4308-901a-f9df40f1229b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117222024-11-14T04:57:12.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6efa98b2-4f91-4308-901a-f9df40f1229b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117232024-11-14T04:57:12.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6efa98b2-4f91-4308-901a-f9df40f1229b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117242024-11-14T04:57:13.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cec64e1-edfa-4fd2-b981-3e15f08c4438 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117252024-11-14T04:57:13.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cec64e1-edfa-4fd2-b981-3e15f08c4438 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117262024-11-14T04:57:13.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9cec64e1-edfa-4fd2-b981-3e15f08c4438 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117272024-11-14T04:57:14.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = db1a3c87-b728-4b3c-8a87-2393dc7ac84b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117282024-11-14T04:57:14.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = db1a3c87-b728-4b3c-8a87-2393dc7ac84b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117292024-11-14T04:57:14.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = db1a3c87-b728-4b3c-8a87-2393dc7ac84b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117302024-11-14T04:57:15.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9aef017e-85b3-479f-8d15-fba2734ab379 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117312024-11-14T04:57:15.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9aef017e-85b3-479f-8d15-fba2734ab379 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117322024-11-14T04:57:15.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9aef017e-85b3-479f-8d15-fba2734ab379 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
117332024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
117342024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
117352024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
117362024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117372024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117382024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117392024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
117402024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
117412024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
117422024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
117432024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
117442024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
117452024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
117462024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
117472024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
117482024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
117492024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117502024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
117512024-11-14T04:57:15.305ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
117522024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
117532024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117542024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
117552024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.611\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
117562024-11-14T04:57:15.305ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117572024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117582024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
117592024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
117602024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117612024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117622024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
117632024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117642024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
117652024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
117662024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
117672024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117682024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117692024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
117702024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
117712024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
117722024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
117732024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
117742024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
117752024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
117762024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
117772024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
117782024-11-14T04:57:15.305ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:47:15.305785024 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
117792024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
117802024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
117812024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
117822024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117832024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
117842024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
117852024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
117862024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
117872024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
117882024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117892024-11-14T04:57:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
117902024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
117912024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
117922024-11-14T04:57:15.306ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
117932024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
117942024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
117952024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117962024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117972024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117982024-11-14T04:57:15.306ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 83071069 } })
117992024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
118002024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118012024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118022024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
118032024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118042024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
118052024-11-14T04:57:15.306ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 83202783 } })
118062024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118072024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118082024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118092024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118102024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118112024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
118122024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
118132024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118142024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
118152024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118162024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118172024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118182024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118192024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
118202024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
118212024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
118222024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 925.277\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
118232024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
118242024-11-14T04:57:15.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.326359ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
118252024-11-14T04:57:15.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118262024-11-14T04:57:15.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118272024-11-14T04:57:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.075628ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
118282024-11-14T04:57:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
118292024-11-14T04:57:15.310ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118302024-11-14T04:57:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118312024-11-14T04:57:15.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118322024-11-14T04:57:15.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118332024-11-14T04:57:15.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118342024-11-14T04:57:15.312ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.853549ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
118352024-11-14T04:57:15.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118362024-11-14T04:57:15.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118372024-11-14T04:57:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118382024-11-14T04:57:15.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118392024-11-14T04:57:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118402024-11-14T04:57:15.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118412024-11-14T04:57:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118422024-11-14T04:57:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118432024-11-14T04:57:15.315ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118442024-11-14T04:57:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118452024-11-14T04:57:15.317ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118462024-11-14T04:57:15.318ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
118472024-11-14T04:57:15.318ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
118482024-11-14T04:57:15.318ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 95836579 } })
118492024-11-14T04:57:15.318ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 13.424499ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
118502024-11-14T04:57:15.319ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
118512024-11-14T04:57:15.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
118522024-11-14T04:57:15.319ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118532024-11-14T04:57:15.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118542024-11-14T04:57:15.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118552024-11-14T04:57:15.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118562024-11-14T04:57:15.322ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118572024-11-14T04:57:15.325ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 102820492 } })
118582024-11-14T04:57:15.325ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:47:15.305785024 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
118592024-11-14T04:57:15.325ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.140304ms iteration = 12 status = {"expiration":"2024-11-14T04:47:15.305785024Z","pruned":[]}
118602024-11-14T04:57:15.326ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
118612024-11-14T04:57:15.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118622024-11-14T04:57:15.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118632024-11-14T04:57:15.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118642024-11-14T04:57:15.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118652024-11-14T04:57:15.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118662024-11-14T04:57:15.331ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118672024-11-14T04:57:15.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118682024-11-14T04:57:15.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118692024-11-14T04:57:15.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118702024-11-14T04:57:15.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118712024-11-14T04:57:15.334ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118722024-11-14T04:57:15.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
118732024-11-14T04:57:15.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118742024-11-14T04:57:15.337ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118752024-11-14T04:57:15.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118762024-11-14T04:57:15.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118772024-11-14T04:57:15.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
118782024-11-14T04:57:15.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118792024-11-14T04:57:15.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118802024-11-14T04:57:15.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118812024-11-14T04:57:15.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
118822024-11-14T04:57:15.361ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118832024-11-14T04:57:15.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118842024-11-14T04:57:15.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118852024-11-14T04:57:15.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
118862024-11-14T04:57:15.368ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118872024-11-14T04:57:15.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118882024-11-14T04:57:15.371ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118892024-11-14T04:57:15.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118902024-11-14T04:57:15.377ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118912024-11-14T04:57:15.378ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1614, tv_nsec: 155160797 } })
118922024-11-14T04:57:15.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118932024-11-14T04:57:15.378ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
118942024-11-14T04:57:15.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.079905ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118952024-11-14T04:57:15.382ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118962024-11-14T04:57:15.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118972024-11-14T04:57:15.387ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.444299ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118982024-11-14T04:57:15.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 88.202115ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
118992024-11-14T04:57:15.394ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 88.651897ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
119002024-11-14T04:57:15.409ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
119012024-11-14T04:57:15.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.845688ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
119022024-11-14T04:57:15.409ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119032024-11-14T04:57:15.409ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
119042024-11-14T04:57:15.409ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
119052024-11-14T04:57:15.409ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
119062024-11-14T04:57:15.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119072024-11-14T04:57:15.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119082024-11-14T04:57:15.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119092024-11-14T04:57:15.411ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119102024-11-14T04:57:15.412ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119112024-11-14T04:57:15.414ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119122024-11-14T04:57:15.414ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
119132024-11-14T04:57:15.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119142024-11-14T04:57:15.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119152024-11-14T04:57:15.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
119162024-11-14T04:57:15.415ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
119172024-11-14T04:57:15.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
119182024-11-14T04:57:15.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119192024-11-14T04:57:15.416ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119202024-11-14T04:57:15.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119212024-11-14T04:57:15.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119222024-11-14T04:57:15.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
119232024-11-14T04:57:15.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119242024-11-14T04:57:15.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119252024-11-14T04:57:15.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119262024-11-14T04:57:15.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119272024-11-14T04:57:15.454ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119282024-11-14T04:57:15.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119292024-11-14T04:57:15.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119302024-11-14T04:57:15.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119312024-11-14T04:57:15.457ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119322024-11-14T04:57:15.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119332024-11-14T04:57:15.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 154.811393ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
119342024-11-14T04:57:15.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
119352024-11-14T04:57:15.461ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119362024-11-14T04:57:15.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119372024-11-14T04:57:15.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
119382024-11-14T04:57:15.462ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119392024-11-14T04:57:15.462ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
119402024-11-14T04:57:15.462ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 157.223364ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
119412024-11-14T04:57:15.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119422024-11-14T04:57:15.465ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 160.134267ms iteration = 23 status = 0
119432024-11-14T04:57:15.467ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
119442024-11-14T04:57:15.467ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
119452024-11-14T04:57:15.467ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
119462024-11-14T04:57:15.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119472024-11-14T04:57:15.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119482024-11-14T04:57:15.469ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
119492024-11-14T04:57:15.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
119502024-11-14T04:57:15.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119512024-11-14T04:57:15.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119522024-11-14T04:57:15.475ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119532024-11-14T04:57:15.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119542024-11-14T04:57:15.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119552024-11-14T04:57:15.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119562024-11-14T04:57:15.476ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
119572024-11-14T04:57:15.476ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119582024-11-14T04:57:15.476ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b30bf2d3-f023-4b50-bb52-99d22483340d", "content-length": "26", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
119592024-11-14T04:57:15.477ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119602024-11-14T04:57:15.478ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
119612024-11-14T04:57:15.478ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
119622024-11-14T04:57:15.478ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119632024-11-14T04:57:15.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119642024-11-14T04:57:15.479ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119652024-11-14T04:57:15.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119662024-11-14T04:57:15.481ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119672024-11-14T04:57:15.481ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
119682024-11-14T04:57:15.481ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119692024-11-14T04:57:15.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119702024-11-14T04:57:15.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119712024-11-14T04:57:15.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119722024-11-14T04:57:15.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
119732024-11-14T04:57:15.489ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
119742024-11-14T04:57:15.489ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
119752024-11-14T04:57:15.489ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
119762024-11-14T04:57:15.489ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 183.685019ms iteration = 12 status = {"generation":2}
119772024-11-14T04:57:15.501ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
119782024-11-14T04:57:15.501ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
119792024-11-14T04:57:15.501ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 195.161142ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
119802024-11-14T04:57:15.506ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
119812024-11-14T04:57:15.506ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119822024-11-14T04:57:15.507ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "334f131c-3bc3-4a4c-a2e8-73881516e497", "content-length": "26", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
119832024-11-14T04:57:15.507ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119842024-11-14T04:57:15.509ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
119852024-11-14T04:57:15.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119862024-11-14T04:57:15.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 229.014912ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
119872024-11-14T04:57:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
119882024-11-14T04:57:15.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119892024-11-14T04:57:15.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119902024-11-14T04:57:15.538ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
119912024-11-14T04:57:15.538ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 232.859763ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
119922024-11-14T04:57:15.541ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119932024-11-14T04:57:15.541ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
119942024-11-14T04:57:15.541ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 235.431308ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
119952024-11-14T04:57:15.548ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
119962024-11-14T04:57:15.548ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119972024-11-14T04:57:15.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119982024-11-14T04:57:15.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119992024-11-14T04:57:15.549ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdb828ec-a1e9-4077-a240-3ce7d45c399b", "content-length": "26", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
120002024-11-14T04:57:15.550ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120012024-11-14T04:57:15.552ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120022024-11-14T04:57:15.561ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
120032024-11-14T04:57:15.568ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
120042024-11-14T04:57:15.568ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 262.260365ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
120052024-11-14T04:57:15.571ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
120062024-11-14T04:57:15.571ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
120072024-11-14T04:57:15.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120082024-11-14T04:57:15.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120092024-11-14T04:57:15.597ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 292.307154ms iteration = 26 status = {"physical_disks_added":0}
120102024-11-14T04:57:15.621ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
120112024-11-14T04:57:15.673ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 367.911515ms iteration = 23 status = {}
120122024-11-14T04:57:15.730ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
120132024-11-14T04:57:15.730ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2fe4686-423d-4971-b901-d16d7f191d07", "content-length": "1", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
120142024-11-14T04:57:15.732ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120152024-11-14T04:57:15.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120162024-11-14T04:57:15.784ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
120172024-11-14T04:57:15.784ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120182024-11-14T04:57:15.784ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe99b66d-3fa7-4745-9304-3976a09ec917", "content-length": "372", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
120192024-11-14T04:57:15.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120202024-11-14T04:57:15.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120212024-11-14T04:57:15.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120222024-11-14T04:57:15.787ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 481.649148ms iteration = 23 status = null
120232024-11-14T04:57:15.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120242024-11-14T04:57:15.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120252024-11-14T04:57:15.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120262024-11-14T04:57:15.793ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
120272024-11-14T04:57:15.793ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
120282024-11-14T04:57:15.793ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
120292024-11-14T04:57:15.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 487.894419ms iteration = 12 status = {"generation":1}
120302024-11-14T04:57:15.809ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
120312024-11-14T04:57:15.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ae238724-7ed5-4f08-bccb-aa3801b1e556", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120322024-11-14T04:57:15.810ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120332024-11-14T04:57:15.812ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "696db4b9-fe03-44fa-ae1b-eb88d406613a", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120342024-11-14T04:57:15.812ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120352024-11-14T04:57:15.813ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
120362024-11-14T04:57:15.814ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
120372024-11-14T04:57:15.814ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 508.965338ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
120382024-11-14T04:57:15.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120392024-11-14T04:57:15.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120402024-11-14T04:57:15.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120412024-11-14T04:57:15.829ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120422024-11-14T04:57:15.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120432024-11-14T04:57:15.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120442024-11-14T04:57:15.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120452024-11-14T04:57:15.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120462024-11-14T04:57:15.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120472024-11-14T04:57:15.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120482024-11-14T04:57:15.844ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
120492024-11-14T04:57:15.844ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
120502024-11-14T04:57:15.844ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b3fe3aa5-6e4d-403f-9c7b-34d42d182ab8", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
120512024-11-14T04:57:15.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120522024-11-14T04:57:15.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120532024-11-14T04:57:15.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120542024-11-14T04:57:15.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120552024-11-14T04:57:15.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120562024-11-14T04:57:15.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120572024-11-14T04:57:15.856ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
120582024-11-14T04:57:15.856ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120592024-11-14T04:57:15.856ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c2672c07-f283-4c4d-b512-79458cf171f0", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
120602024-11-14T04:57:15.858ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 552.763056ms iteration = 23 status = {}
120612024-11-14T04:57:15.867ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
120622024-11-14T04:57:15.868ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c427f526-87dc-4405-9597-1e266f1f088f", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
120632024-11-14T04:57:15.868ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
120642024-11-14T04:57:15.869ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "348c5511-5856-4924-9ed6-d0c9dfff41e0", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
120652024-11-14T04:57:15.869ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
120662024-11-14T04:57:15.872ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4dcb8104-d11e-4c4f-ad9a-65073e21b81b", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
120672024-11-14T04:57:15.872ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
120682024-11-14T04:57:15.874ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
120692024-11-14T04:57:15.875ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 569.298745ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
120702024-11-14T04:57:15.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120712024-11-14T04:57:15.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120722024-11-14T04:57:15.882ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
120732024-11-14T04:57:15.882ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120742024-11-14T04:57:15.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120752024-11-14T04:57:15.894ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
120762024-11-14T04:57:15.894ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dd70593-69cd-42ac-b6e7-a67babcb64cf", "content-length": "134", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
120772024-11-14T04:57:15.894ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
120782024-11-14T04:57:15.894ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
120792024-11-14T04:57:15.894ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
120802024-11-14T04:57:15.894ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
120812024-11-14T04:57:15.894ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120822024-11-14T04:57:15.894ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120832024-11-14T04:57:15.894ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120842024-11-14T04:57:15.894ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120852024-11-14T04:57:15.895ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
120862024-11-14T04:57:15.895ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
120872024-11-14T04:57:15.895ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
120882024-11-14T04:57:15.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120892024-11-14T04:57:15.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120902024-11-14T04:57:15.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
120912024-11-14T04:57:15.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "593b8f3e-9491-48eb-ab4b-00161bb1cb60", "content-length": "2", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
120922024-11-14T04:57:15.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
120932024-11-14T04:57:15.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "91b23093-cd4d-482d-bea0-2019a7d25989", "content-length": "51", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
120942024-11-14T04:57:15.897ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
120952024-11-14T04:57:15.897ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
120962024-11-14T04:57:15.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d9737721-0bb3-4b5a-a3a5-cf26a12f826b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
120972024-11-14T04:57:15.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d9737721-0bb3-4b5a-a3a5-cf26a12f826b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
120982024-11-14T04:57:15.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = d9737721-0bb3-4b5a-a3a5-cf26a12f826b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
120992024-11-14T04:57:15.946ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
121002024-11-14T04:57:16.010ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "accb741e-9395-45a6-b5ad-3d74ba8ad709", "content-length": "691", "date": "Thu, 14 Nov 2024 04:57:16 GMT"} })
121012024-11-14T04:57:16.010ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
121022024-11-14T04:57:16.010ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
121032024-11-14T04:57:16.010ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
121042024-11-14T04:57:16.012ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 706.363825ms iteration = 23 status = {}
121052024-11-14T04:57:16.067ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
121062024-11-14T04:57:16.067ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
121072024-11-14T04:57:16.098ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
121082024-11-14T04:57:16.098ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:54954
121092024-11-14T04:57:16.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54954 req_id = 6cebf2e4-786f-43f4-bc8c-7f63e29fe51f roles = RoleSet { roles: {} } uri = /metrics/producers
121102024-11-14T04:57:16.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54954 req_id = 6cebf2e4-786f-43f4-bc8c-7f63e29fe51f resource = Database result = Ok(()) uri = /metrics/producers
121112024-11-14T04:57:16.133ZINFOnexus: assigned collector to new producer collector_id = 459b411b-9021-43ae-8875-254e55794157 file = nexus/src/app/oximeter.rs:76 producer_id = 79994e02-6747-4071-83af-7872b31640fb
121122024-11-14T04:57:16.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35485 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54954 req_id = 6cebf2e4-786f-43f4-bc8c-7f63e29fe51f response_code = 201 uri = /metrics/producers
121132024-11-14T04:57:16.133ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6cebf2e4-786f-43f4-bc8c-7f63e29fe51f", "content-length": "41", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
121142024-11-14T04:57:16.136ZDEBGnexus (producer-registration-task): registered with nexus successfully
121152024-11-14T04:57:16.136ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
121162024-11-14T04:57:16.189ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "579290ff-9777-478e-97e2-16abe8bef96b", "date": "Thu, 14 Nov 2024 04:57:15 GMT"} })
121172024-11-14T04:57:16.189ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
121182024-11-14T04:57:16.189ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
121192024-11-14T04:57:16.189ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1b9d9ad-e7d8-4129-bb15-e2127fbe02f3", "content-length": "682", "date": "Thu, 14 Nov 2024 04:57:16 GMT"} })
121202024-11-14T04:57:16.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121212024-11-14T04:57:16.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121222024-11-14T04:57:16.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121232024-11-14T04:57:16.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121242024-11-14T04:57:16.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121252024-11-14T04:57:16.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121262024-11-14T04:57:16.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121272024-11-14T04:57:16.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121282024-11-14T04:57:16.205ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 900.094495ms iteration = 23 status = {}
121292024-11-14T04:57:16.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15038009-9bf0-41db-8718-ac138d39a5d0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121302024-11-14T04:57:16.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15038009-9bf0-41db-8718-ac138d39a5d0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121312024-11-14T04:57:16.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 15038009-9bf0-41db-8718-ac138d39a5d0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121322024-11-14T04:57:17.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cee8b220-e5c1-4a13-bbbb-1a37a746a408 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121332024-11-14T04:57:17.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cee8b220-e5c1-4a13-bbbb-1a37a746a408 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121342024-11-14T04:57:17.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = cee8b220-e5c1-4a13-bbbb-1a37a746a408 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121352024-11-14T04:57:18.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41f82f39-c718-4589-982a-9b430411d5b1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121362024-11-14T04:57:18.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41f82f39-c718-4589-982a-9b430411d5b1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121372024-11-14T04:57:18.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 41f82f39-c718-4589-982a-9b430411d5b1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121382024-11-14T04:57:19.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 519b1302-3cca-4926-80f5-59d2815eba1d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121392024-11-14T04:57:19.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 519b1302-3cca-4926-80f5-59d2815eba1d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121402024-11-14T04:57:19.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 519b1302-3cca-4926-80f5-59d2815eba1d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121412024-11-14T04:57:20.256ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 3ed9cacd-b608-45b5-9bf1-df8bd42a9efc response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
121422024-11-14T04:57:20.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dfcebfb2-6a9d-49e9-bccf-e3c25ef114a4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121432024-11-14T04:57:20.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dfcebfb2-6a9d-49e9-bccf-e3c25ef114a4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121442024-11-14T04:57:20.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dfcebfb2-6a9d-49e9-bccf-e3c25ef114a4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121452024-11-14T04:57:21.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 08437f3b-d821-414c-ac3c-99f4e815ceba roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121462024-11-14T04:57:21.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 08437f3b-d821-414c-ac3c-99f4e815ceba resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121472024-11-14T04:57:21.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 08437f3b-d821-414c-ac3c-99f4e815ceba response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121482024-11-14T04:57:22.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 261ca3ba-a244-4bf6-8cd8-3efee1f77ff1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121492024-11-14T04:57:22.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 261ca3ba-a244-4bf6-8cd8-3efee1f77ff1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121502024-11-14T04:57:22.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 261ca3ba-a244-4bf6-8cd8-3efee1f77ff1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121512024-11-14T04:57:23.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 978cfe14-29d4-4285-b0f1-b43a74a345f9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121522024-11-14T04:57:23.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 978cfe14-29d4-4285-b0f1-b43a74a345f9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121532024-11-14T04:57:23.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 978cfe14-29d4-4285-b0f1-b43a74a345f9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121542024-11-14T04:57:24.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8b495bd5-86bb-42f4-b0d1-4b98f6b62f0b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121552024-11-14T04:57:24.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8b495bd5-86bb-42f4-b0d1-4b98f6b62f0b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121562024-11-14T04:57:24.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8b495bd5-86bb-42f4-b0d1-4b98f6b62f0b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121572024-11-14T04:57:25.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
121582024-11-14T04:57:25.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
121592024-11-14T04:57:25.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121602024-11-14T04:57:25.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121612024-11-14T04:57:25.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121622024-11-14T04:57:25.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121632024-11-14T04:57:25.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121642024-11-14T04:57:25.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121652024-11-14T04:57:25.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121662024-11-14T04:57:25.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121672024-11-14T04:57:25.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121682024-11-14T04:57:25.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121692024-11-14T04:57:25.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121702024-11-14T04:57:25.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121712024-11-14T04:57:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121722024-11-14T04:57:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
121732024-11-14T04:57:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121742024-11-14T04:57:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121752024-11-14T04:57:25.327ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
121762024-11-14T04:57:25.327ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.949465ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
121772024-11-14T04:57:25.335ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.298518ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121782024-11-14T04:57:25.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2ec29338-2aaf-4fc7-9726-2e9feb4ff0c9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121792024-11-14T04:57:25.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2ec29338-2aaf-4fc7-9726-2e9feb4ff0c9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121802024-11-14T04:57:25.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2ec29338-2aaf-4fc7-9726-2e9feb4ff0c9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121812024-11-14T04:57:26.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aed85ee1-ffef-4804-a289-65fbef836855 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121822024-11-14T04:57:26.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aed85ee1-ffef-4804-a289-65fbef836855 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121832024-11-14T04:57:26.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = aed85ee1-ffef-4804-a289-65fbef836855 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121842024-11-14T04:57:27.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a74039fc-65a9-42ee-b4e1-6ed0c68e928d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121852024-11-14T04:57:27.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a74039fc-65a9-42ee-b4e1-6ed0c68e928d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121862024-11-14T04:57:27.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a74039fc-65a9-42ee-b4e1-6ed0c68e928d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121872024-11-14T04:57:28.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 545594a7-5a46-4b76-8abb-39757d18b2a6 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121882024-11-14T04:57:28.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 545594a7-5a46-4b76-8abb-39757d18b2a6 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121892024-11-14T04:57:28.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 545594a7-5a46-4b76-8abb-39757d18b2a6 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121902024-11-14T04:57:29.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 084543c8-c30e-45a9-94ca-86fd52d13941 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121912024-11-14T04:57:29.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 084543c8-c30e-45a9-94ca-86fd52d13941 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121922024-11-14T04:57:29.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 084543c8-c30e-45a9-94ca-86fd52d13941 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121932024-11-14T04:57:30.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 11230ec5-e3a3-497a-a129-74ce909d62d1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121942024-11-14T04:57:30.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 11230ec5-e3a3-497a-a129-74ce909d62d1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121952024-11-14T04:57:30.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 11230ec5-e3a3-497a-a129-74ce909d62d1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121962024-11-14T04:57:31.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ece19e7b-d516-4d0b-a2f8-74035e194806 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121972024-11-14T04:57:31.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ece19e7b-d516-4d0b-a2f8-74035e194806 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121982024-11-14T04:57:31.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ece19e7b-d516-4d0b-a2f8-74035e194806 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
121992024-11-14T04:57:32.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 317e5e5a-dc94-466e-a94e-42b91c208fd0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122002024-11-14T04:57:32.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 317e5e5a-dc94-466e-a94e-42b91c208fd0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122012024-11-14T04:57:32.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 317e5e5a-dc94-466e-a94e-42b91c208fd0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122022024-11-14T04:57:33.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 72b78ebb-6f3a-4ba7-a33c-90089f2e2db5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122032024-11-14T04:57:33.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 72b78ebb-6f3a-4ba7-a33c-90089f2e2db5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122042024-11-14T04:57:33.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 72b78ebb-6f3a-4ba7-a33c-90089f2e2db5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122052024-11-14T04:57:34.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a628ecc3-b0de-4974-87bc-6aedfc701411 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122062024-11-14T04:57:34.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a628ecc3-b0de-4974-87bc-6aedfc701411 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122072024-11-14T04:57:34.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a628ecc3-b0de-4974-87bc-6aedfc701411 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122082024-11-14T04:57:35.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 745 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 7d3fa7c7-a890-4c45-83ae-ce41bef4d312 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
122092024-11-14T04:57:35.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
122102024-11-14T04:57:35.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122112024-11-14T04:57:35.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
122122024-11-14T04:57:35.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122132024-11-14T04:57:35.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122142024-11-14T04:57:35.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122152024-11-14T04:57:35.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122162024-11-14T04:57:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122172024-11-14T04:57:35.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122182024-11-14T04:57:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122192024-11-14T04:57:35.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122202024-11-14T04:57:35.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122212024-11-14T04:57:35.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122222024-11-14T04:57:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
122232024-11-14T04:57:35.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122242024-11-14T04:57:35.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122252024-11-14T04:57:35.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
122262024-11-14T04:57:35.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.519045ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
122272024-11-14T04:57:35.334ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122282024-11-14T04:57:35.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122292024-11-14T04:57:35.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.948676ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122302024-11-14T04:57:35.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04b8f9c5-4c64-4e9f-a0d5-66334bb93a82 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122312024-11-14T04:57:35.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04b8f9c5-4c64-4e9f-a0d5-66334bb93a82 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122322024-11-14T04:57:35.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 04b8f9c5-4c64-4e9f-a0d5-66334bb93a82 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122332024-11-14T04:57:36.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26f1a2cf-ef0a-47e6-a7ee-d1c53417d5dc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122342024-11-14T04:57:36.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26f1a2cf-ef0a-47e6-a7ee-d1c53417d5dc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122352024-11-14T04:57:36.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 26f1a2cf-ef0a-47e6-a7ee-d1c53417d5dc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122362024-11-14T04:57:37.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 70f89ee3-2923-4880-9341-f26dad61e8f4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122372024-11-14T04:57:37.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 70f89ee3-2923-4880-9341-f26dad61e8f4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122382024-11-14T04:57:37.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 70f89ee3-2923-4880-9341-f26dad61e8f4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122392024-11-14T04:57:38.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1252fabe-bbe0-415a-98b5-3f4177b6bf70 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122402024-11-14T04:57:38.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1252fabe-bbe0-415a-98b5-3f4177b6bf70 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122412024-11-14T04:57:38.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1252fabe-bbe0-415a-98b5-3f4177b6bf70 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122422024-11-14T04:57:39.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee9e36fc-c4c7-4986-adcb-fe71458885bd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122432024-11-14T04:57:39.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee9e36fc-c4c7-4986-adcb-fe71458885bd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122442024-11-14T04:57:39.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee9e36fc-c4c7-4986-adcb-fe71458885bd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122452024-11-14T04:57:40.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = a16509eb-5713-4bdb-b385-60223156544f roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
122462024-11-14T04:57:40.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = a16509eb-5713-4bdb-b385-60223156544f resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
122472024-11-14T04:57:40.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = a16509eb-5713-4bdb-b385-60223156544f response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
122482024-11-14T04:57:40.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 82b84354-325a-4447-8a0c-e28c4e071874 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
122492024-11-14T04:57:40.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 82b84354-325a-4447-8a0c-e28c4e071874 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
122502024-11-14T04:57:40.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 82b84354-325a-4447-8a0c-e28c4e071874 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
122512024-11-14T04:57:40.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec1f2470-0b46-4a89-bc29-db9e37651bad roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122522024-11-14T04:57:40.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec1f2470-0b46-4a89-bc29-db9e37651bad resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122532024-11-14T04:57:40.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec1f2470-0b46-4a89-bc29-db9e37651bad response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122542024-11-14T04:57:41.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3eaa34e7-d9d0-41d5-be31-ef55e4c217fd roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122552024-11-14T04:57:41.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3eaa34e7-d9d0-41d5-be31-ef55e4c217fd resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122562024-11-14T04:57:41.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3eaa34e7-d9d0-41d5-be31-ef55e4c217fd response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122572024-11-14T04:57:42.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13839df8-f08a-429d-8baa-6970928c4fa5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122582024-11-14T04:57:42.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13839df8-f08a-429d-8baa-6970928c4fa5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122592024-11-14T04:57:42.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 13839df8-f08a-429d-8baa-6970928c4fa5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122602024-11-14T04:57:43.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c1b3bac-8e53-48d4-8201-61f92954ffea roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122612024-11-14T04:57:43.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c1b3bac-8e53-48d4-8201-61f92954ffea resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122622024-11-14T04:57:43.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7c1b3bac-8e53-48d4-8201-61f92954ffea response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122632024-11-14T04:57:44.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0c7427d-7cfa-488e-8e8b-f43b873a1263 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122642024-11-14T04:57:44.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0c7427d-7cfa-488e-8e8b-f43b873a1263 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122652024-11-14T04:57:44.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = b0c7427d-7cfa-488e-8e8b-f43b873a1263 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
122662024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
122672024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122682024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
122692024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
122702024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122712024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122722024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
122732024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122742024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
122752024-11-14T04:57:45.305ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
122762024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122772024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
122782024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
122792024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
122802024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122812024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
122822024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
122832024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
122842024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122852024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122862024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
122872024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
122882024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
122892024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
122902024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
122912024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
122922024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122932024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
122942024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
122952024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
122962024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
122972024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
122982024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
122992024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
123002024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123012024-11-14T04:57:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123022024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123032024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123042024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123052024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123062024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123072024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
123082024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123092024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123102024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
123112024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
123122024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123132024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123142024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123152024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123162024-11-14T04:57:45.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
123172024-11-14T04:57:45.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123182024-11-14T04:57:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123192024-11-14T04:57:45.309ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123202024-11-14T04:57:45.309ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.385997ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
123212024-11-14T04:57:45.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123222024-11-14T04:57:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123232024-11-14T04:57:45.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123242024-11-14T04:57:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123252024-11-14T04:57:45.311ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123262024-11-14T04:57:45.311ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
123272024-11-14T04:57:45.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123282024-11-14T04:57:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123292024-11-14T04:57:45.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123302024-11-14T04:57:45.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123312024-11-14T04:57:45.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123322024-11-14T04:57:45.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123332024-11-14T04:57:45.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123342024-11-14T04:57:45.314ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1644, tv_nsec: 91430116 } })
123352024-11-14T04:57:45.314ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.728993ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
123362024-11-14T04:57:45.314ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
123372024-11-14T04:57:45.315ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1644, tv_nsec: 92607780 } })
123382024-11-14T04:57:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
123392024-11-14T04:57:45.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
123402024-11-14T04:57:45.315ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
123412024-11-14T04:57:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
123422024-11-14T04:57:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
123432024-11-14T04:57:45.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123442024-11-14T04:57:45.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123452024-11-14T04:57:45.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123462024-11-14T04:57:45.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.641855ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
123472024-11-14T04:57:45.319ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.961264ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123482024-11-14T04:57:45.320ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123492024-11-14T04:57:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123502024-11-14T04:57:45.321ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
123512024-11-14T04:57:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123522024-11-14T04:57:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
123532024-11-14T04:57:45.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123542024-11-14T04:57:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123552024-11-14T04:57:45.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123562024-11-14T04:57:45.328ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123572024-11-14T04:57:45.329ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
123582024-11-14T04:57:45.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123592024-11-14T04:57:45.329ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1644, tv_nsec: 107090459 } })
123602024-11-14T04:57:45.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123612024-11-14T04:57:45.330ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
123622024-11-14T04:57:45.331ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123632024-11-14T04:57:45.331ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123642024-11-14T04:57:45.331ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
123652024-11-14T04:57:45.331ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.327683ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
123662024-11-14T04:57:45.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123672024-11-14T04:57:45.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123682024-11-14T04:57:45.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123692024-11-14T04:57:45.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123702024-11-14T04:57:45.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123712024-11-14T04:57:45.380ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123722024-11-14T04:57:45.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123732024-11-14T04:57:45.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123742024-11-14T04:57:45.385ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.338788ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
123752024-11-14T04:57:45.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123762024-11-14T04:57:45.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123772024-11-14T04:57:45.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123782024-11-14T04:57:45.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123792024-11-14T04:57:45.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123802024-11-14T04:57:45.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123812024-11-14T04:57:45.393ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.750451ms iteration = 27 status = {"physical_disks_added":0}
123822024-11-14T04:57:45.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
123832024-11-14T04:57:45.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123842024-11-14T04:57:45.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123852024-11-14T04:57:45.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123862024-11-14T04:57:45.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123872024-11-14T04:57:45.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123882024-11-14T04:57:45.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123892024-11-14T04:57:45.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123902024-11-14T04:57:45.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123912024-11-14T04:57:45.400ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123922024-11-14T04:57:45.400ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
123932024-11-14T04:57:45.400ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123942024-11-14T04:57:45.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123952024-11-14T04:57:45.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.173325ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
123962024-11-14T04:57:45.417ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
123972024-11-14T04:57:45.417ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.947862ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
123982024-11-14T04:57:45.435ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
123992024-11-14T04:57:45.435ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124002024-11-14T04:57:45.435ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4c90f2b-a637-4632-9065-3c0b6253d46f", "content-length": "26", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124012024-11-14T04:57:45.436ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124022024-11-14T04:57:45.438ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124032024-11-14T04:57:45.439ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124042024-11-14T04:57:45.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
124052024-11-14T04:57:45.439ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124062024-11-14T04:57:45.439ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "695d52cc-2b0e-4022-a435-10733f9ebe1a", "content-length": "26", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124072024-11-14T04:57:45.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124082024-11-14T04:57:45.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124092024-11-14T04:57:45.441ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124102024-11-14T04:57:45.459ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
124112024-11-14T04:57:45.459ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124122024-11-14T04:57:45.459ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2644080-f63a-475d-9abf-9cae224d2764", "content-length": "26", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124132024-11-14T04:57:45.459ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124142024-11-14T04:57:45.462ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
124152024-11-14T04:57:45.494ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
124162024-11-14T04:57:45.494ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124172024-11-14T04:57:45.494ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab66c64d-caf9-40da-b92f-79cda618b47a", "content-length": "372", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124182024-11-14T04:57:45.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124192024-11-14T04:57:45.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124202024-11-14T04:57:45.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124212024-11-14T04:57:45.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 193.705229ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
124222024-11-14T04:57:45.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
124232024-11-14T04:57:45.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124242024-11-14T04:57:45.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124252024-11-14T04:57:45.505ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 200.154287ms iteration = 24 status = 0
124262024-11-14T04:57:45.536ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 231.319209ms iteration = 24 status = {}
124272024-11-14T04:57:45.539ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
124282024-11-14T04:57:45.540ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "496dcade-b004-422f-88b9-5de109e944cd", "content-length": "1", "date": "Thu, 14 Nov 2024 04:57:44 GMT"} })
124292024-11-14T04:57:45.543ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124302024-11-14T04:57:45.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124312024-11-14T04:57:45.547ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 242.211924ms iteration = 24 status = null
124322024-11-14T04:57:45.554ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124332024-11-14T04:57:45.554ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
124342024-11-14T04:57:45.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 249.462374ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
124352024-11-14T04:57:45.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124362024-11-14T04:57:45.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124372024-11-14T04:57:45.558ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
124382024-11-14T04:57:45.558ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
124392024-11-14T04:57:45.558ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4be68c3e-88c5-4cc2-a035-2c77d82520b1", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124402024-11-14T04:57:45.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124412024-11-14T04:57:45.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124422024-11-14T04:57:45.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124432024-11-14T04:57:45.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124442024-11-14T04:57:45.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124452024-11-14T04:57:45.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124462024-11-14T04:57:45.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124472024-11-14T04:57:45.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124482024-11-14T04:57:45.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124492024-11-14T04:57:45.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124502024-11-14T04:57:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124512024-11-14T04:57:45.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124522024-11-14T04:57:45.566ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124532024-11-14T04:57:45.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124542024-11-14T04:57:45.570ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124552024-11-14T04:57:45.570ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124562024-11-14T04:57:45.570ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6469a7a1-f45d-4bd9-9155-1e270102b20b", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124572024-11-14T04:57:45.572ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.431165ms iteration = 24 status = {}
124582024-11-14T04:57:45.642ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
124592024-11-14T04:57:45.642ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9019985-89ba-425a-b8f3-64facc9ea9e7", "content-length": "691", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124602024-11-14T04:57:45.643ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
124612024-11-14T04:57:45.643ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
124622024-11-14T04:57:45.643ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
124632024-11-14T04:57:45.644ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 339.07346ms iteration = 24 status = {}
124642024-11-14T04:57:45.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124652024-11-14T04:57:45.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124662024-11-14T04:57:45.670ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
124672024-11-14T04:57:45.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124682024-11-14T04:57:45.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124692024-11-14T04:57:45.683ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
124702024-11-14T04:57:45.683ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1e57064-8a4e-42a4-99b2-22305eb57a39", "content-length": "134", "date": "Thu, 14 Nov 2024 04:57:44 GMT"} })
124712024-11-14T04:57:45.683ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
124722024-11-14T04:57:45.683ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
124732024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
124742024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
124752024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124762024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124772024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124782024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124792024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
124802024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
124812024-11-14T04:57:45.684ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
124822024-11-14T04:57:45.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124832024-11-14T04:57:45.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124842024-11-14T04:57:45.687ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
124852024-11-14T04:57:45.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffdf8fe7-c758-4e84-b0dd-65adaceff904", "content-length": "2", "date": "Thu, 14 Nov 2024 04:57:44 GMT"} })
124862024-11-14T04:57:45.687ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
124872024-11-14T04:57:45.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "11eed58f-de71-48fc-91ae-844af138bb40", "content-length": "51", "date": "Thu, 14 Nov 2024 04:57:44 GMT"} })
124882024-11-14T04:57:45.687ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
124892024-11-14T04:57:45.687ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
124902024-11-14T04:57:45.843ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0a0dd48a-c1c8-448c-af8f-9f64f515bfb4", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124912024-11-14T04:57:45.843ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
124922024-11-14T04:57:45.843ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
124932024-11-14T04:57:45.844ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3936dd2e-3197-4b57-91a6-cf0c3aac4b83", "content-length": "682", "date": "Thu, 14 Nov 2024 04:57:45 GMT"} })
124942024-11-14T04:57:45.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124952024-11-14T04:57:45.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124962024-11-14T04:57:45.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124972024-11-14T04:57:45.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124982024-11-14T04:57:45.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124992024-11-14T04:57:45.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125002024-11-14T04:57:45.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125012024-11-14T04:57:45.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125022024-11-14T04:57:45.867ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 562.368226ms iteration = 24 status = {}
125032024-11-14T04:57:45.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1dc857c6-26f9-495a-a523-5a8821d01de0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125042024-11-14T04:57:45.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1dc857c6-26f9-495a-a523-5a8821d01de0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125052024-11-14T04:57:45.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1dc857c6-26f9-495a-a523-5a8821d01de0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125062024-11-14T04:57:45.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 981c72f5-90ed-4aee-aa8d-79c14e393ed8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
125072024-11-14T04:57:45.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 981c72f5-90ed-4aee-aa8d-79c14e393ed8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
125082024-11-14T04:57:45.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 981c72f5-90ed-4aee-aa8d-79c14e393ed8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
125092024-11-14T04:57:46.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f3dd442e-4fd9-4afe-968a-70a8d2898514 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125102024-11-14T04:57:46.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f3dd442e-4fd9-4afe-968a-70a8d2898514 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125112024-11-14T04:57:46.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f3dd442e-4fd9-4afe-968a-70a8d2898514 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125122024-11-14T04:57:47.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 197e3763-dea4-48fb-88de-8f50aca68a04 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125132024-11-14T04:57:47.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 197e3763-dea4-48fb-88de-8f50aca68a04 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125142024-11-14T04:57:47.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 197e3763-dea4-48fb-88de-8f50aca68a04 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125152024-11-14T04:57:48.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 483f045a-f70c-4749-870d-dcdb14847078 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
125162024-11-14T04:57:48.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 483f045a-f70c-4749-870d-dcdb14847078 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
125172024-11-14T04:57:48.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 483f045a-f70c-4749-870d-dcdb14847078 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
125182024-11-14T04:57:48.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c6be02aa-be74-4a3b-8225-625344c68e80 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
125192024-11-14T04:57:48.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c6be02aa-be74-4a3b-8225-625344c68e80 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
125202024-11-14T04:57:48.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c6be02aa-be74-4a3b-8225-625344c68e80 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
125212024-11-14T04:57:48.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75b357bc-8f71-4694-a1d3-ad5f0ce07d89 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125222024-11-14T04:57:48.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75b357bc-8f71-4694-a1d3-ad5f0ce07d89 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125232024-11-14T04:57:48.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 75b357bc-8f71-4694-a1d3-ad5f0ce07d89 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125242024-11-14T04:57:50.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec55d614-b083-4a56-9998-41c8c2b34f78 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125252024-11-14T04:57:50.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec55d614-b083-4a56-9998-41c8c2b34f78 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125262024-11-14T04:57:50.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec55d614-b083-4a56-9998-41c8c2b34f78 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125272024-11-14T04:57:50.256ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 891 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 384e208f-7304-49f5-a291-8292b6345260 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
125282024-11-14T04:57:51.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4838a1ce-1cc5-445c-8526-3468aeeb5f9e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125292024-11-14T04:57:51.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4838a1ce-1cc5-445c-8526-3468aeeb5f9e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125302024-11-14T04:57:51.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4838a1ce-1cc5-445c-8526-3468aeeb5f9e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125312024-11-14T04:57:52.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94154bc1-bdaa-48e9-bbe4-12ce745033ab roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125322024-11-14T04:57:52.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94154bc1-bdaa-48e9-bbe4-12ce745033ab resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125332024-11-14T04:57:52.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 94154bc1-bdaa-48e9-bbe4-12ce745033ab response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125342024-11-14T04:57:53.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee8651ff-ce81-45be-9640-db18f166189e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125352024-11-14T04:57:53.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee8651ff-ce81-45be-9640-db18f166189e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125362024-11-14T04:57:53.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ee8651ff-ce81-45be-9640-db18f166189e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125372024-11-14T04:57:54.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 92e94524-31f4-4105-b600-b895d2447dcb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125382024-11-14T04:57:54.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 92e94524-31f4-4105-b600-b895d2447dcb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125392024-11-14T04:57:54.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 92e94524-31f4-4105-b600-b895d2447dcb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125402024-11-14T04:57:55.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 312266cd-56ab-45a0-b7fb-b93d8a87d1c9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125412024-11-14T04:57:55.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 312266cd-56ab-45a0-b7fb-b93d8a87d1c9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125422024-11-14T04:57:55.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 312266cd-56ab-45a0-b7fb-b93d8a87d1c9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125432024-11-14T04:57:55.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
125442024-11-14T04:57:55.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
125452024-11-14T04:57:55.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125462024-11-14T04:57:55.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125472024-11-14T04:57:55.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125482024-11-14T04:57:55.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125492024-11-14T04:57:55.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125502024-11-14T04:57:55.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
125512024-11-14T04:57:55.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
125522024-11-14T04:57:55.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.904193ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125532024-11-14T04:57:55.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
125542024-11-14T04:57:55.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125552024-11-14T04:57:55.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125562024-11-14T04:57:55.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125572024-11-14T04:57:55.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125582024-11-14T04:57:55.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125592024-11-14T04:57:55.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
125602024-11-14T04:57:55.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125612024-11-14T04:57:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125622024-11-14T04:57:55.325ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
125632024-11-14T04:57:55.325ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.638318ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
125642024-11-14T04:57:56.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d56d8281-b73c-495e-99da-42af0f813013 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125652024-11-14T04:57:56.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d56d8281-b73c-495e-99da-42af0f813013 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125662024-11-14T04:57:56.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d56d8281-b73c-495e-99da-42af0f813013 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125672024-11-14T04:57:57.047ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c73ff36-1861-4bac-ad42-72e89f1dbf2d remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f5456443-79b7-4f5c-8a61-261c8de9ae9f uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-14T04:57:57.029895537Z }
125682024-11-14T04:57:57.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f5456443-79b7-4f5c-8a61-261c8de9ae9f roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
125692024-11-14T04:57:57.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f5456443-79b7-4f5c-8a61-261c8de9ae9f resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
125702024-11-14T04:57:57.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59002 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f5456443-79b7-4f5c-8a61-261c8de9ae9f response_code = 204 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
125712024-11-14T04:57:57.090ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c73ff36-1861-4bac-ad42-72e89f1dbf2d remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ab0ffdb-2bcb-4e21-a14c-5b4cf0619c98 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-14T04:57:57.090671688Z }
125722024-11-14T04:57:57.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ab0ffdb-2bcb-4e21-a14c-5b4cf0619c98 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
125732024-11-14T04:57:57.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ab0ffdb-2bcb-4e21-a14c-5b4cf0619c98 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
125742024-11-14T04:57:57.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8634 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ab0ffdb-2bcb-4e21-a14c-5b4cf0619c98 response_code = 204 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
125752024-11-14T04:57:57.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7970289e-9dac-4245-a70d-1f75ffe3fb78 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125762024-11-14T04:57:57.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7970289e-9dac-4245-a70d-1f75ffe3fb78 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125772024-11-14T04:57:57.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7970289e-9dac-4245-a70d-1f75ffe3fb78 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125782024-11-14T04:57:58.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f9c0699b-25fa-4c38-86c1-53d24fb8f11b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125792024-11-14T04:57:58.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f9c0699b-25fa-4c38-86c1-53d24fb8f11b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125802024-11-14T04:57:58.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f9c0699b-25fa-4c38-86c1-53d24fb8f11b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125812024-11-14T04:57:59.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 202478aa-619c-401a-a138-761b4db3047d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125822024-11-14T04:57:59.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 202478aa-619c-401a-a138-761b4db3047d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125832024-11-14T04:57:59.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 202478aa-619c-401a-a138-761b4db3047d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125842024-11-14T04:58:00.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fcc44178-b3c3-495e-a74c-2943d84bbb2d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125852024-11-14T04:58:00.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fcc44178-b3c3-495e-a74c-2943d84bbb2d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125862024-11-14T04:58:00.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fcc44178-b3c3-495e-a74c-2943d84bbb2d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125872024-11-14T04:58:01.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9da46751-45b5-416d-b6cc-d6156f691ec5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125882024-11-14T04:58:01.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9da46751-45b5-416d-b6cc-d6156f691ec5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125892024-11-14T04:58:01.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9da46751-45b5-416d-b6cc-d6156f691ec5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125902024-11-14T04:58:02.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 972af9b9-b294-4be6-b4d8-d10bbcd936f4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125912024-11-14T04:58:02.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 972af9b9-b294-4be6-b4d8-d10bbcd936f4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125922024-11-14T04:58:02.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 972af9b9-b294-4be6-b4d8-d10bbcd936f4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125932024-11-14T04:58:03.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e5312d52-fcfa-42ce-9e1f-155516057aee roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125942024-11-14T04:58:03.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e5312d52-fcfa-42ce-9e1f-155516057aee resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125952024-11-14T04:58:03.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e5312d52-fcfa-42ce-9e1f-155516057aee response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125962024-11-14T04:58:04.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = acf53b3a-e210-4747-8919-3f622be29f08 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125972024-11-14T04:58:04.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = acf53b3a-e210-4747-8919-3f622be29f08 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125982024-11-14T04:58:04.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = acf53b3a-e210-4747-8919-3f622be29f08 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
125992024-11-14T04:58:05.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 98a92eab-16ac-4036-8ce7-c3b7d64f768d response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
126002024-11-14T04:58:05.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
126012024-11-14T04:58:05.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
126022024-11-14T04:58:05.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126032024-11-14T04:58:05.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126042024-11-14T04:58:05.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126052024-11-14T04:58:05.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126062024-11-14T04:58:05.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126072024-11-14T04:58:05.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126082024-11-14T04:58:05.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126092024-11-14T04:58:05.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.091818ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126102024-11-14T04:58:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126112024-11-14T04:58:05.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126122024-11-14T04:58:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126132024-11-14T04:58:05.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126142024-11-14T04:58:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126152024-11-14T04:58:05.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126162024-11-14T04:58:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
126172024-11-14T04:58:05.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126182024-11-14T04:58:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126192024-11-14T04:58:05.327ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
126202024-11-14T04:58:05.327ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.503242ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
126212024-11-14T04:58:05.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0d128a3d-c3d7-4c29-a216-1de3f9c9480e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126222024-11-14T04:58:05.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0d128a3d-c3d7-4c29-a216-1de3f9c9480e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126232024-11-14T04:58:05.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 0d128a3d-c3d7-4c29-a216-1de3f9c9480e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126242024-11-14T04:58:06.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df5867e6-fca6-4501-a7d7-da07b5c21ae4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126252024-11-14T04:58:06.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df5867e6-fca6-4501-a7d7-da07b5c21ae4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126262024-11-14T04:58:06.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df5867e6-fca6-4501-a7d7-da07b5c21ae4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126272024-11-14T04:58:06.903ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c73ff36-1861-4bac-ad42-72e89f1dbf2d remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d3151c65-f869-416e-92df-4e35d4182915 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-14T04:58:06.903144453Z }
126282024-11-14T04:58:06.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d3151c65-f869-416e-92df-4e35d4182915 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126292024-11-14T04:58:06.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d3151c65-f869-416e-92df-4e35d4182915 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126302024-11-14T04:58:06.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d3151c65-f869-416e-92df-4e35d4182915 response_code = 204 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126312024-11-14T04:58:07.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5aab3e21-e538-49d3-bb7f-8310545fcc25 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126322024-11-14T04:58:07.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5aab3e21-e538-49d3-bb7f-8310545fcc25 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126332024-11-14T04:58:07.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5aab3e21-e538-49d3-bb7f-8310545fcc25 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126342024-11-14T04:58:07.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 9dc19031-fbe6-4b8a-9421-4a7c2ac105c1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
126352024-11-14T04:58:07.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 9dc19031-fbe6-4b8a-9421-4a7c2ac105c1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
126362024-11-14T04:58:08.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 9dc19031-fbe6-4b8a-9421-4a7c2ac105c1 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
126372024-11-14T04:58:08.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 18ec619a-b60a-496d-8794-4fb6e39a5861 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126382024-11-14T04:58:08.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 18ec619a-b60a-496d-8794-4fb6e39a5861 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126392024-11-14T04:58:08.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 18ec619a-b60a-496d-8794-4fb6e39a5861 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126402024-11-14T04:58:08.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 907bbdea-1445-4794-af0c-672e35970766 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126412024-11-14T04:58:08.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 907bbdea-1445-4794-af0c-672e35970766 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126422024-11-14T04:58:08.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 907bbdea-1445-4794-af0c-672e35970766 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126432024-11-14T04:58:09.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c351d87c-2586-4739-ad9e-c03c772bb167 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126442024-11-14T04:58:09.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c351d87c-2586-4739-ad9e-c03c772bb167 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126452024-11-14T04:58:09.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c351d87c-2586-4739-ad9e-c03c772bb167 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126462024-11-14T04:58:09.346ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c73ff36-1861-4bac-ad42-72e89f1dbf2d remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T04:58:09.345955905Z }
126472024-11-14T04:58:09.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126482024-11-14T04:58:09.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126492024-11-14T04:58:09.359ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 2c73ff36-1861-4bac-ad42-72e89f1dbf2d remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d vmm_needs_update = true
126502024-11-14T04:58:09.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126512024-11-14T04:58:09.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126522024-11-14T04:58:09.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126532024-11-14T04:58:09.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126542024-11-14T04:58:09.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126552024-11-14T04:58:09.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126562024-11-14T04:58:09.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126572024-11-14T04:58:09.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126582024-11-14T04:58:09.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126592024-11-14T04:58:09.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126602024-11-14T04:58:09.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126612024-11-14T04:58:09.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126622024-11-14T04:58:09.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126632024-11-14T04:58:09.380ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 992dae43-7740-49b5-814b-c5341916fc63, lookup_type: ById(992dae43-7740-49b5-814b-c5341916fc63) }, key: cc48da91-268d-48d2-b3ae-6259a7958913, lookup_type: ById(cc48da91-268d-48d2-b3ae-6259a7958913) }, key: f872674e-3abd-4856-abe7-9936da747fcf, lookup_type: ById(f872674e-3abd-4856-abe7-9936da747fcf) } result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126642024-11-14T04:58:09.387ZINFOnexus (dropshot_internal): starting update saga for f872674e-3abd-4856-abe7-9936da747fcf actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = f872674e-3abd-4856-abe7-9936da747fcf local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T04:58:09.345955905Z }
126652024-11-14T04:58:09.387ZDEBGnexus (dropshot_internal): preparing instance-update saga for f872674e-3abd-4856-abe7-9936da747fcf... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f872674e-3abd-4856-abe7-9936da747fcf local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126662024-11-14T04:58:09.387ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update
126672024-11-14T04:58:09.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40998 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a7208249-f726-4ff8-bd12-2be94c1dcee2 response_code = 204 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126682024-11-14T04:58:09.387ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c73ff36-1861-4bac-ad42-72e89f1dbf2d remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 45306562-237f-4591-86d7-d38094602a46 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-14T04:58:09.345955905Z }
126692024-11-14T04:58:09.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 45306562-237f-4591-86d7-d38094602a46 roles = RoleSet { roles: {} } uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126702024-11-14T04:58:09.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 45306562-237f-4591-86d7-d38094602a46 resource = Database result = Ok(()) uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126712024-11-14T04:58:09.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6660 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 45306562-237f-4591-86d7-d38094602a46 response_code = 204 uri = /vmms/2c73ff36-1861-4bac-ad42-72e89f1dbf2d
126722024-11-14T04:58:09.394ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f872674e-3abd-4856-abe7-9936da747fcf","lookup_type":{"ById":"f872674e-3abd-4856-abe7-9936da747fcf"},"parent":{"key":"cc48da91-268d-48d2-b3ae-6259a7958913","lookup_type":{"ById":"cc48da91-268d-48d2-b3ae-6259a7958913"},"parent":{"key":"992dae43-7740-49b5-814b-c5341916fc63","lookup_type":{"ById":"992dae43-7740-49b5-814b-c5341916fc63"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update sec_id = 79994e02-6747-4071-83af-7872b31640fb
126732024-11-14T04:58:09.397ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update
126742024-11-14T04:58:09.445ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update
126752024-11-14T04:58:09.445ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update sec_id = 79994e02-6747-4071-83af-7872b31640fb
126762024-11-14T04:58:09.445ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
126772024-11-14T04:58:09.445ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
126782024-11-14T04:58:09.451ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
126792024-11-14T04:58:09.451ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
126802024-11-14T04:58:09.454ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
126812024-11-14T04:58:09.454ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
126822024-11-14T04:58:09.462ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
126832024-11-14T04:58:09.462ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bdb39c23-a828-456e-8290-dadec96bc1b2")) node_id = 0 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
126842024-11-14T04:58:09.467ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
126852024-11-14T04:58:09.467ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
126862024-11-14T04:58:09.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a13d1216-b42e-4384-adb2-5291ea868044 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126872024-11-14T04:58:09.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a13d1216-b42e-4384-adb2-5291ea868044 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126882024-11-14T04:58:09.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a13d1216-b42e-4384-adb2-5291ea868044 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
126892024-11-14T04:58:09.487ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update
126902024-11-14T04:58:09.490ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126912024-11-14T04:58:09.490ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126922024-11-14T04:58:09.494ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126932024-11-14T04:58:09.494ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126942024-11-14T04:58:09.496ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126952024-11-14T04:58:09.496ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126962024-11-14T04:58:09.498ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126972024-11-14T04:58:09.498ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126982024-11-14T04:58:09.499ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
126992024-11-14T04:58:09.500ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127002024-11-14T04:58:09.501ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127012024-11-14T04:58:09.501ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127022024-11-14T04:58:09.502ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127032024-11-14T04:58:09.505ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 992dae43-7740-49b5-814b-c5341916fc63, lookup_type: ById(992dae43-7740-49b5-814b-c5341916fc63) }, key: cc48da91-268d-48d2-b3ae-6259a7958913, lookup_type: ById(cc48da91-268d-48d2-b3ae-6259a7958913) }, key: f872674e-3abd-4856-abe7-9936da747fcf, lookup_type: ById(f872674e-3abd-4856-abe7-9936da747fcf) } result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127042024-11-14T04:58:09.505ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance updater_id = bdb39c23-a828-456e-8290-dadec96bc1b2
127052024-11-14T04:58:09.505ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127062024-11-14T04:58:09.505ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127072024-11-14T04:58:09.521ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance updater_id = bdb39c23-a828-456e-8290-dadec96bc1b2
127082024-11-14T04:58:09.521ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127092024-11-14T04:58:09.521ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance
127102024-11-14T04:58:09.525ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f872674e-3abd-4856-abe7-9936da747fcf locked_gen = Generation(Generation(2)) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = LockInstance updater_id = bdb39c23-a828-456e-8290-dadec96bc1b2
127112024-11-14T04:58:09.533ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
127122024-11-14T04:58:09.533ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bdb39c23-a828-456e-8290-dadec96bc1b2")}) node_id = 1 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
127132024-11-14T04:58:09.536ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
127142024-11-14T04:58:09.536ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
127152024-11-14T04:58:09.547ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127162024-11-14T04:58:09.547ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127172024-11-14T04:58:09.549ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127182024-11-14T04:58:09.549ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127192024-11-14T04:58:09.551ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127202024-11-14T04:58:09.551ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127212024-11-14T04:58:09.552ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127222024-11-14T04:58:09.555ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 992dae43-7740-49b5-814b-c5341916fc63, lookup_type: ById(992dae43-7740-49b5-814b-c5341916fc63) }, key: cc48da91-268d-48d2-b3ae-6259a7958913, lookup_type: ById(cc48da91-268d-48d2-b3ae-6259a7958913) }, key: f872674e-3abd-4856-abe7-9936da747fcf, lookup_type: ById(f872674e-3abd-4856-abe7-9936da747fcf) } result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127232024-11-14T04:58:09.555ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127242024-11-14T04:58:09.555ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
127252024-11-14T04:58:09.563ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 2c73ff36-1861-4bac-ad42-72e89f1dbf2d, time_created: 2024-11-14T04:57:48.672333Z, time_deleted: None, instance_id: f872674e-3abd-4856-abe7-9936da747fcf, sled_id: c073d51c-abaa-48df-abb6-2f053e9c1bec, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-14T04:58:09.345955Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-14T04:57:46.439838Z, gen: Generation(Generation(3)), propolis_id: Some(2c73ff36-1861-4bac-ad42-72e89f1dbf2d), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(2c73ff36-1861-4bac-ad42-72e89f1dbf2d (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-14T04:58:09.563363040Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
127262024-11-14T04:58:09.563ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127272024-11-14T04:58:09.565ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f872674e-3abd-4856-abe7-9936da747fcf","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"2c73ff36-1861-4bac-ad42-72e89f1dbf2d"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"f872674e-3abd-4856-abe7-9936da747fcf","lookup_type":{"ById":"f872674e-3abd-4856-abe7-9936da747fcf"},"parent":{"key":"cc48da91-268d-48d2-b3ae-6259a7958913","lookup_type":{"ById":"cc48da91-268d-48d2-b3ae-6259a7958913"},"parent":{"key":"992dae43-7740-49b5-814b-c5341916fc63","lookup_type":{"ById":"992dae43-7740-49b5-814b-c5341916fc63"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"bdb39c23-a828-456e-8290-dadec96bc1b2"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"cc48da91-268d-48d2-b3ae-6259a7958913","ram_diff":1073741824},"destroy_active_vmm":"2c73ff36-1861-4bac-ad42-72e89f1dbf2d","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-14T04:58:09.563363040Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update sec_id = 79994e02-6747-4071-83af-7872b31640fb
127282024-11-14T04:58:09.565ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127292024-11-14T04:58:09.599ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127302024-11-14T04:58:09.599ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update sec_id = 79994e02-6747-4071-83af-7872b31640fb
127312024-11-14T04:58:09.599ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
127322024-11-14T04:58:09.599ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127332024-11-14T04:58:09.604ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
127342024-11-14T04:58:09.604ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127352024-11-14T04:58:09.609ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
127362024-11-14T04:58:09.609ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127372024-11-14T04:58:09.613ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
127382024-11-14T04:58:09.613ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ddd55c0a-894d-41ef-9107-c9b33a685efb")) node_id = 0 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127392024-11-14T04:58:09.617ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
127402024-11-14T04:58:09.617ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127412024-11-14T04:58:09.622ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f872674e-3abd-4856-abe7-9936da747fcf parent_lock = UpdaterLock { updater_id: bdb39c23-a828-456e-8290-dadec96bc1b2, locked_gen: Generation(Generation(2)) } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127422024-11-14T04:58:09.622ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = BecomeUpdater
127432024-11-14T04:58:09.622ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = BecomeUpdater
127442024-11-14T04:58:09.643ZDEBGnexus (SagaExecutor): inherited lock from bdb39c23-a828-456e-8290-dadec96bc1b2 to ddd55c0a-894d-41ef-9107-c9b33a685efb actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f872674e-3abd-4856-abe7-9936da747fcf locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = bdb39c23-a828-456e-8290-dadec96bc1b2 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = BecomeUpdater updater_id = ddd55c0a-894d-41ef-9107-c9b33a685efb
127452024-11-14T04:58:09.643ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127462024-11-14T04:58:09.643ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
127472024-11-14T04:58:09.643ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ddd55c0a-894d-41ef-9107-c9b33a685efb")}) node_id = 1 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127482024-11-14T04:58:09.650ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
127492024-11-14T04:58:09.650ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127502024-11-14T04:58:09.656ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
127512024-11-14T04:58:09.656ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127522024-11-14T04:58:09.659ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
127532024-11-14T04:58:09.659ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127542024-11-14T04:58:09.663ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127552024-11-14T04:58:09.666ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f872674e-3abd-4856-abe7-9936da747fcf
127562024-11-14T04:58:09.666ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UpdateNetworkConfig
127572024-11-14T04:58:09.666ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UpdateNetworkConfig
127582024-11-14T04:58:09.671ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UpdateNetworkConfig
127592024-11-14T04:58:09.671ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UpdateNetworkConfig
127602024-11-14T04:58:09.679ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
127612024-11-14T04:58:09.679ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UpdateNetworkConfig
127622024-11-14T04:58:09.679ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UpdateNetworkConfig
127632024-11-14T04:58:09.681ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
127642024-11-14T04:58:09.681ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
127652024-11-14T04:58:09.682ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
127662024-11-14T04:58:09.683ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
127672024-11-14T04:58:09.684ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
127682024-11-14T04:58:09.684ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
127692024-11-14T04:58:09.684ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
127702024-11-14T04:58:09.691ZDEBGnexus: notifying dendrite of updates instance_id = Some(f872674e-3abd-4856-abe7-9936da747fcf (instance)) switch = switch0
127712024-11-14T04:58:09.691ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1668, tv_nsec: 469073801 } })
127722024-11-14T04:58:09.691ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
127732024-11-14T04:58:09.721ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
127742024-11-14T04:58:09.721ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
127752024-11-14T04:58:09.722ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab7c63f1-e4ab-474a-a247-202a37edeb70", "content-length": "26", "date": "Thu, 14 Nov 2024 04:58:09 GMT"} })
127762024-11-14T04:58:09.722ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
127772024-11-14T04:58:09.722ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
127782024-11-14T04:58:09.753ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
127792024-11-14T04:58:09.754ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "51a87686-f74c-4b4c-934b-a707d5ddc9fc", "content-length": "4", "date": "Thu, 14 Nov 2024 04:58:08 GMT"} })
127802024-11-14T04:58:09.754ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
127812024-11-14T04:58:09.754ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127822024-11-14T04:58:09.760ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
127832024-11-14T04:58:09.760ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127842024-11-14T04:58:09.770ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
127852024-11-14T04:58:09.770ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
127862024-11-14T04:58:09.788ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = f872674e-3abd-4856-abe7-9936da747fcf records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-14T04:58:09.773255Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 992dae43-7740-49b5-814b-c5341916fc63, time_modified: Some(2024-11-14T04:58:09.773255Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: cc48da91-268d-48d2-b3ae-6259a7958913, time_modified: Some(2024-11-14T04:58:09.773255Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127872024-11-14T04:58:09.788ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
127882024-11-14T04:58:09.788ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127892024-11-14T04:58:09.792ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
127902024-11-14T04:58:09.792ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
127912024-11-14T04:58:09.795ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127922024-11-14T04:58:09.796ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UnassignOximeterProducer
127932024-11-14T04:58:09.796ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UnassignOximeterProducer
127942024-11-14T04:58:09.804ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 459b411b-9021-43ae-8875-254e55794157 producer_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127952024-11-14T04:58:09.804ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UnassignOximeterProducer
127962024-11-14T04:58:09.804ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = UnassignOximeterProducer
127972024-11-14T04:58:09.838ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
127982024-11-14T04:58:09.840ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f872674e-3abd-4856-abe7-9936da747fcf
127992024-11-14T04:58:09.853ZDEBGnexus (SagaExecutor): client response oximeter-collector = f872674e-3abd-4856-abe7-9936da747fcf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/f872674e-3abd-4856-abe7-9936da747fcf", status: 204, headers: {"x-request-id": "f24f31cd-2e6b-49c0-87f5-372866d0c0e0", "date": "Thu, 14 Nov 2024 04:58:09 GMT"} }) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
128002024-11-14T04:58:09.853ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 459b411b-9021-43ae-8875-254e55794157 producer_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
128012024-11-14T04:58:09.855ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128022024-11-14T04:58:09.855ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128032024-11-14T04:58:09.858ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
128042024-11-14T04:58:09.858ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128052024-11-14T04:58:09.861ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f872674e-3abd-4856-abe7-9936da747fcf lock = UpdaterLock { updater_id: ddd55c0a-894d-41ef-9107-c9b33a685efb, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-14T04:58:09.563363040Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
128062024-11-14T04:58:09.861ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = CommitInstanceUpdates
128072024-11-14T04:58:09.862ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = CommitInstanceUpdates
128082024-11-14T04:58:09.919ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = f872674e-3abd-4856-abe7-9936da747fcf new_runtime = InstanceRuntimeState { time_updated: 2024-11-14T04:58:09.563363040Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
128092024-11-14T04:58:09.919ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128102024-11-14T04:58:09.919ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128112024-11-14T04:58:09.919ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
128122024-11-14T04:58:09.919ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
128132024-11-14T04:58:09.919ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
128142024-11-14T04:58:09.919ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128152024-11-14T04:58:09.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128162024-11-14T04:58:09.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128172024-11-14T04:58:09.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128182024-11-14T04:58:09.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128192024-11-14T04:58:09.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128202024-11-14T04:58:09.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128212024-11-14T04:58:09.923ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
128222024-11-14T04:58:09.923ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128232024-11-14T04:58:09.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128242024-11-14T04:58:09.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128252024-11-14T04:58:09.926ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128262024-11-14T04:58:09.926ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f872674e-3abd-4856-abe7-9936da747fcf"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2c73ff36-1861-4bac-ad42-72e89f1dbf2d")}) node_id = 7 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128272024-11-14T04:58:09.926ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128282024-11-14T04:58:09.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128292024-11-14T04:58:09.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128302024-11-14T04:58:09.929ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
128312024-11-14T04:58:09.929ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128322024-11-14T04:58:09.933ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128332024-11-14T04:58:09.933ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128342024-11-14T04:58:09.935ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
128352024-11-14T04:58:09.936ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128362024-11-14T04:58:09.942ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f872674e-3abd-4856-abe7-9936da747fcf propolis_id = 2c73ff36-1861-4bac-ad42-72e89f1dbf2d saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
128372024-11-14T04:58:09.942ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ReleaseSledResources
128382024-11-14T04:58:09.942ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ReleaseSledResources
128392024-11-14T04:58:09.947ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128402024-11-14T04:58:09.947ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128412024-11-14T04:58:09.960ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
128422024-11-14T04:58:09.960ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
128432024-11-14T04:58:09.960ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcef656b-3c66-479b-acb0-df8a08257172", "content-length": "372", "date": "Thu, 14 Nov 2024 04:58:09 GMT"} })
128442024-11-14T04:58:09.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128452024-11-14T04:58:09.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128462024-11-14T04:58:09.964ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
128472024-11-14T04:58:09.964ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128482024-11-14T04:58:09.968ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f872674e-3abd-4856-abe7-9936da747fcf propolis_id = 2c73ff36-1861-4bac-ad42-72e89f1dbf2d saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
128492024-11-14T04:58:09.968ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = MarkVmmDeleted
128502024-11-14T04:58:09.969ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = MarkVmmDeleted
128512024-11-14T04:58:09.982ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128522024-11-14T04:58:09.982ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128532024-11-14T04:58:09.986ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
128542024-11-14T04:58:09.986ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128552024-11-14T04:58:09.990ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128562024-11-14T04:58:09.990ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128572024-11-14T04:58:09.994ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
128582024-11-14T04:58:09.994ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128592024-11-14T04:58:09.997ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128602024-11-14T04:58:09.997ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128612024-11-14T04:58:09.999ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128622024-11-14T04:58:09.999ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128632024-11-14T04:58:10.000ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128642024-11-14T04:58:10.001ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128652024-11-14T04:58:10.002ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128662024-11-14T04:58:10.006ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 992dae43-7740-49b5-814b-c5341916fc63, lookup_type: ById(992dae43-7740-49b5-814b-c5341916fc63) }, key: cc48da91-268d-48d2-b3ae-6259a7958913, lookup_type: ById(cc48da91-268d-48d2-b3ae-6259a7958913) }, key: f872674e-3abd-4856-abe7-9936da747fcf, lookup_type: ById(f872674e-3abd-4856-abe7-9936da747fcf) } result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128672024-11-14T04:58:10.006ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128682024-11-14T04:58:10.006ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_node = ChainSuccessorSaga
128692024-11-14T04:58:10.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 53a804f7-3d06-4cd5-b377-875e29508c98 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
128702024-11-14T04:58:10.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 53a804f7-3d06-4cd5-b377-875e29508c98 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
128712024-11-14T04:58:10.011ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = f872674e-3abd-4856-abe7-9936da747fcf karmic_state = WillReincarnate needs_reincarnation = false saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update
128722024-11-14T04:58:10.011ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128732024-11-14T04:58:10.011ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128742024-11-14T04:58:10.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 53a804f7-3d06-4cd5-b377-875e29508c98 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
128752024-11-14T04:58:10.016ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
128762024-11-14T04:58:10.016ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128772024-11-14T04:58:10.020ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128782024-11-14T04:58:10.020ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128792024-11-14T04:58:10.024ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 sec_id = 79994e02-6747-4071-83af-7872b31640fb
128802024-11-14T04:58:10.024ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94
128812024-11-14T04:58:10.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128822024-11-14T04:58:10.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128832024-11-14T04:58:10.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128842024-11-14T04:58:10.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128852024-11-14T04:58:10.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128862024-11-14T04:58:10.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128872024-11-14T04:58:10.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128882024-11-14T04:58:10.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128892024-11-14T04:58:10.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128902024-11-14T04:58:10.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
128912024-11-14T04:58:10.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128922024-11-14T04:58:10.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128932024-11-14T04:58:10.060ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update sec_id = 79994e02-6747-4071-83af-7872b31640fb
128942024-11-14T04:58:10.060ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 saga_name = instance-update saga_result = SagaResult { saga_id: 644af0b4-2aa0-43de-af49-de64da2c8c94, saga_log: SagaLog { saga_id: 644af0b4-2aa0-43de-af49-de64da2c8c94, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("ddd55c0a-894d-41ef-9107-c9b33a685efb")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("ddd55c0a-894d-41ef-9107-c9b33a685efb")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f872674e-3abd-4856-abe7-9936da747fcf"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2c73ff36-1861-4bac-ad42-72e89f1dbf2d")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f872674e-3abd-4856-abe7-9936da747fcf"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2c73ff36-1861-4bac-ad42-72e89f1dbf2d")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("ddd55c0a-894d-41ef-9107-c9b33a685efb"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("ddd55c0a-894d-41ef-9107-c9b33a685efb")}} }) }
128952024-11-14T04:58:10.060ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 644af0b4-2aa0-43de-af49-de64da2c8c94 instance_id = f872674e-3abd-4856-abe7-9936da747fcf saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update
128962024-11-14T04:58:10.060ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
128972024-11-14T04:58:10.060ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
128982024-11-14T04:58:10.063ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
128992024-11-14T04:58:10.063ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
129002024-11-14T04:58:10.064ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 79994e02-6747-4071-83af-7872b31640fb
129012024-11-14T04:58:10.064ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
129022024-11-14T04:58:10.064ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2fd10b61-ce2c-4db1-bbe8-977521bd63e9", "date": "Thu, 14 Nov 2024 04:58:09 GMT"} })
129032024-11-14T04:58:10.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129042024-11-14T04:58:10.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129052024-11-14T04:58:10.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129062024-11-14T04:58:10.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129072024-11-14T04:58:10.068ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 79994e02-6747-4071-83af-7872b31640fb
129082024-11-14T04:58:10.068ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
129092024-11-14T04:58:10.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129102024-11-14T04:58:10.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129112024-11-14T04:58:10.079ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
129122024-11-14T04:58:10.080ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4116cbf1-f3fd-48e1-b3be-36f885215b00", "content-length": "691", "date": "Thu, 14 Nov 2024 04:58:10 GMT"} })
129132024-11-14T04:58:10.080ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
129142024-11-14T04:58:10.080ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
129152024-11-14T04:58:10.080ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
129162024-11-14T04:58:10.081ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 161.527558ms iteration = 25 status = {}
129172024-11-14T04:58:10.083ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 sec_id = 79994e02-6747-4071-83af-7872b31640fb
129182024-11-14T04:58:10.083ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 921084e9-97da-42de-aaf2-77496fa3d577
129192024-11-14T04:58:10.087ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
129202024-11-14T04:58:10.087ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
129212024-11-14T04:58:10.088ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1a9c14d8-2319-4737-ab31-0e718244903d", "date": "Thu, 14 Nov 2024 04:58:10 GMT"} })
129222024-11-14T04:58:10.089ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 169.931752ms iteration = 25 status = {}
129232024-11-14T04:58:10.091ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update sec_id = 79994e02-6747-4071-83af-7872b31640fb
129242024-11-14T04:58:10.091ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 921084e9-97da-42de-aaf2-77496fa3d577 saga_name = start-instance-update saga_result = SagaResult { saga_id: 921084e9-97da-42de-aaf2-77496fa3d577, saga_log: SagaLog { saga_id: 921084e9-97da-42de-aaf2-77496fa3d577, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("bdb39c23-a828-456e-8290-dadec96bc1b2")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("bdb39c23-a828-456e-8290-dadec96bc1b2")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("bdb39c23-a828-456e-8290-dadec96bc1b2"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("bdb39c23-a828-456e-8290-dadec96bc1b2")}} }) }
129252024-11-14T04:58:10.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 632695bb-6265-41fe-b717-0dbdf33747b2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129262024-11-14T04:58:10.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 632695bb-6265-41fe-b717-0dbdf33747b2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129272024-11-14T04:58:10.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 632695bb-6265-41fe-b717-0dbdf33747b2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129282024-11-14T04:58:11.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be177c0d-1a47-485e-8a77-66e1166bb52b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129292024-11-14T04:58:11.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be177c0d-1a47-485e-8a77-66e1166bb52b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129302024-11-14T04:58:11.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = be177c0d-1a47-485e-8a77-66e1166bb52b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129312024-11-14T04:58:12.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 65a9420f-5806-4a1d-b0c5-b7eaa36a8d5b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
129322024-11-14T04:58:12.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 65a9420f-5806-4a1d-b0c5-b7eaa36a8d5b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
129332024-11-14T04:58:12.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = 65a9420f-5806-4a1d-b0c5-b7eaa36a8d5b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
129342024-11-14T04:58:12.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1933a183-69b3-49dc-9e47-d4499d61c5a8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129352024-11-14T04:58:12.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1933a183-69b3-49dc-9e47-d4499d61c5a8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129362024-11-14T04:58:12.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1933a183-69b3-49dc-9e47-d4499d61c5a8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129372024-11-14T04:58:13.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 938fd4cf-3b0f-4377-a2fa-9c975756698c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129382024-11-14T04:58:13.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 938fd4cf-3b0f-4377-a2fa-9c975756698c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129392024-11-14T04:58:13.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 938fd4cf-3b0f-4377-a2fa-9c975756698c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129402024-11-14T04:58:14.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 027567fb-6e01-416d-9ff3-2222aa1ed870 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129412024-11-14T04:58:14.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 027567fb-6e01-416d-9ff3-2222aa1ed870 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129422024-11-14T04:58:14.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 027567fb-6e01-416d-9ff3-2222aa1ed870 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
129432024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
129442024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
129452024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
129462024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129472024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
129482024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129492024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
129502024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
129512024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
129522024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
129532024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129542024-11-14T04:58:15.305ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:48:15.305159664 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
129552024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
129562024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
129572024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
129582024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
129592024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
129602024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
129612024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
129622024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129632024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
129642024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
129652024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129662024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
129672024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129682024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
129692024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
129702024-11-14T04:58:15.305ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
129712024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
129722024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
129732024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
129742024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
129752024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
129762024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129772024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
129782024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
129792024-11-14T04:58:15.305ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
129802024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
129812024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.87\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
129822024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
129832024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
129842024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
129852024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
129862024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
129872024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
129882024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
129892024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
129902024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129912024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
129922024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
129932024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
129942024-11-14T04:58:15.305ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
129952024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129962024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
129972024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
129982024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
129992024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130002024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
130012024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
130022024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130032024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
130042024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130052024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
130062024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130072024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
130082024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
130092024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
130102024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130112024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130122024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130132024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130142024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
130152024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130162024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130172024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
130182024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
130192024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130202024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
130212024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130222024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
130232024-11-14T04:58:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
130242024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
130252024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130262024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130272024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
130282024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130292024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130302024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130312024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130322024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130332024-11-14T04:58:15.306ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1674, tv_nsec: 83549005 } })
130342024-11-14T04:58:15.306ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1674, tv_nsec: 83555545 } })
130352024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130362024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130372024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130382024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130392024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
130402024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.352149ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
130412024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
130422024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.257447ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
130432024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130442024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130452024-11-14T04:58:15.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130462024-11-14T04:58:15.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130472024-11-14T04:58:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130482024-11-14T04:58:15.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130492024-11-14T04:58:15.309ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:48:15.305159664 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
130502024-11-14T04:58:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.201911ms iteration = 13 status = {"expiration":"2024-11-14T04:48:15.305159664Z","pruned":[]}
130512024-11-14T04:58:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
130522024-11-14T04:58:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
130532024-11-14T04:58:15.311ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
130542024-11-14T04:58:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
130552024-11-14T04:58:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
130562024-11-14T04:58:15.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.339661ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
130572024-11-14T04:58:15.313ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130582024-11-14T04:58:15.313ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1674, tv_nsec: 91158326 } })
130592024-11-14T04:58:15.313ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
130602024-11-14T04:58:15.314ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.912318ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
130612024-11-14T04:58:15.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130622024-11-14T04:58:15.315ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130632024-11-14T04:58:15.315ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
130642024-11-14T04:58:15.315ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130652024-11-14T04:58:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130662024-11-14T04:58:15.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130672024-11-14T04:58:15.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130682024-11-14T04:58:15.317ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
130692024-11-14T04:58:15.317ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
130702024-11-14T04:58:15.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
130712024-11-14T04:58:15.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
130722024-11-14T04:58:15.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
130732024-11-14T04:58:15.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
130742024-11-14T04:58:15.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130752024-11-14T04:58:15.320ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1674, tv_nsec: 97959223 } })
130762024-11-14T04:58:15.320ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
130772024-11-14T04:58:15.322ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.637651ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
130782024-11-14T04:58:15.322ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130792024-11-14T04:58:15.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130802024-11-14T04:58:15.323ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
130812024-11-14T04:58:15.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
130822024-11-14T04:58:15.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
130832024-11-14T04:58:15.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
130842024-11-14T04:58:15.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
130852024-11-14T04:58:15.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130862024-11-14T04:58:15.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130872024-11-14T04:58:15.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130882024-11-14T04:58:15.326ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130892024-11-14T04:58:15.327ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 22.177993ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
130902024-11-14T04:58:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
130912024-11-14T04:58:15.329ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
130922024-11-14T04:58:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
130932024-11-14T04:58:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
130942024-11-14T04:58:15.329ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
130952024-11-14T04:58:15.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
130962024-11-14T04:58:15.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130972024-11-14T04:58:15.331ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130982024-11-14T04:58:15.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130992024-11-14T04:58:15.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131002024-11-14T04:58:15.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131012024-11-14T04:58:15.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
131022024-11-14T04:58:15.335ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
131032024-11-14T04:58:15.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
131042024-11-14T04:58:15.337ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131052024-11-14T04:58:15.340ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
131062024-11-14T04:58:15.340ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
131072024-11-14T04:58:15.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
131082024-11-14T04:58:15.347ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131092024-11-14T04:58:15.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131102024-11-14T04:58:15.348ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.452939ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131112024-11-14T04:58:15.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
131122024-11-14T04:58:15.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
131132024-11-14T04:58:15.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
131142024-11-14T04:58:15.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131152024-11-14T04:58:15.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131162024-11-14T04:58:15.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131172024-11-14T04:58:15.357ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
131182024-11-14T04:58:15.357ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
131192024-11-14T04:58:15.357ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 52.010606ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
131202024-11-14T04:58:15.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131212024-11-14T04:58:15.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131222024-11-14T04:58:15.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131232024-11-14T04:58:15.358ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
131242024-11-14T04:58:15.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
131252024-11-14T04:58:15.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131262024-11-14T04:58:15.365ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
131272024-11-14T04:58:15.365ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
131282024-11-14T04:58:15.365ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
131292024-11-14T04:58:15.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131302024-11-14T04:58:15.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131312024-11-14T04:58:15.368ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
131322024-11-14T04:58:15.368ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
131332024-11-14T04:58:15.368ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
131342024-11-14T04:58:15.368ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
131352024-11-14T04:58:15.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131362024-11-14T04:58:15.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
131372024-11-14T04:58:15.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131382024-11-14T04:58:15.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131392024-11-14T04:58:15.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131402024-11-14T04:58:15.371ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131412024-11-14T04:58:15.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131422024-11-14T04:58:15.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
131432024-11-14T04:58:15.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131442024-11-14T04:58:15.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131452024-11-14T04:58:15.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131462024-11-14T04:58:15.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
131472024-11-14T04:58:15.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131482024-11-14T04:58:15.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131492024-11-14T04:58:15.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
131502024-11-14T04:58:15.383ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131512024-11-14T04:58:15.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131522024-11-14T04:58:15.388ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131532024-11-14T04:58:15.393ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131542024-11-14T04:58:15.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
131552024-11-14T04:58:15.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
131562024-11-14T04:58:15.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
131572024-11-14T04:58:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
131582024-11-14T04:58:15.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
131592024-11-14T04:58:15.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131602024-11-14T04:58:15.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
131612024-11-14T04:58:15.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
131622024-11-14T04:58:15.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
131632024-11-14T04:58:15.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
131642024-11-14T04:58:15.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
131652024-11-14T04:58:15.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
131662024-11-14T04:58:15.405ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
131672024-11-14T04:58:15.405ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
131682024-11-14T04:58:15.405ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131692024-11-14T04:58:15.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
131702024-11-14T04:58:15.409ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
131712024-11-14T04:58:15.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
131722024-11-14T04:58:15.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131732024-11-14T04:58:15.422ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
131742024-11-14T04:58:15.422ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.40926ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
131752024-11-14T04:58:15.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
131762024-11-14T04:58:15.423ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
131772024-11-14T04:58:15.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
131782024-11-14T04:58:15.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.027859ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
131792024-11-14T04:58:15.435ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
131802024-11-14T04:58:15.435ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.490079ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
131812024-11-14T04:58:15.446ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
131822024-11-14T04:58:15.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131832024-11-14T04:58:15.447ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
131842024-11-14T04:58:15.447ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 141.602901ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
131852024-11-14T04:58:15.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.367973ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
131862024-11-14T04:58:15.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
131872024-11-14T04:58:15.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131882024-11-14T04:58:15.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131892024-11-14T04:58:15.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131902024-11-14T04:58:15.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131912024-11-14T04:58:15.458ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131922024-11-14T04:58:15.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131932024-11-14T04:58:15.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
131942024-11-14T04:58:15.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
131952024-11-14T04:58:15.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
131962024-11-14T04:58:15.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
131972024-11-14T04:58:15.485ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
131982024-11-14T04:58:15.485ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
131992024-11-14T04:58:15.486ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14513d9a-c1ea-471e-a400-079545b853f7", "content-length": "26", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
132002024-11-14T04:58:15.486ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
132012024-11-14T04:58:15.488ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
132022024-11-14T04:58:15.515ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
132032024-11-14T04:58:15.535ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
132042024-11-14T04:58:15.540ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
132052024-11-14T04:58:15.540ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
132062024-11-14T04:58:15.541ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b44cd6d-334c-41e8-8d56-56b984695bfa", "content-length": "26", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
132072024-11-14T04:58:15.541ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
132082024-11-14T04:58:15.542ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
132092024-11-14T04:58:15.611ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
132102024-11-14T04:58:15.611ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132112024-11-14T04:58:15.612ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a682bc3f-f58b-4ac6-a73b-effc05793c54", "content-length": "372", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
132122024-11-14T04:58:15.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132132024-11-14T04:58:15.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132142024-11-14T04:58:15.618ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 313.090796ms iteration = 6 status = {"nsuccess":5}
132152024-11-14T04:58:15.618ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132162024-11-14T04:58:15.618ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
132172024-11-14T04:58:15.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132182024-11-14T04:58:15.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132192024-11-14T04:58:15.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132202024-11-14T04:58:15.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132212024-11-14T04:58:15.620ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1674, tv_nsec: 398409143 } })
132222024-11-14T04:58:15.621ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
132232024-11-14T04:58:15.621ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 316.186037ms iteration = 25 status = {}
132242024-11-14T04:58:15.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
132252024-11-14T04:58:15.623ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132262024-11-14T04:58:15.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
132272024-11-14T04:58:15.623ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
132282024-11-14T04:58:15.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132292024-11-14T04:58:15.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
132302024-11-14T04:58:15.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e02ca83b-580f-456b-9ad6-98ab5409082e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
132312024-11-14T04:58:15.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e02ca83b-580f-456b-9ad6-98ab5409082e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
132322024-11-14T04:58:15.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e02ca83b-580f-456b-9ad6-98ab5409082e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
132332024-11-14T04:58:15.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132342024-11-14T04:58:15.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132352024-11-14T04:58:15.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132362024-11-14T04:58:15.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132372024-11-14T04:58:15.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132382024-11-14T04:58:15.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
132392024-11-14T04:58:15.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132402024-11-14T04:58:15.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132412024-11-14T04:58:15.654ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 349.159971ms iteration = 25 status = 0
132422024-11-14T04:58:15.657ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
132432024-11-14T04:58:15.658ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
132442024-11-14T04:58:15.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
132452024-11-14T04:58:15.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132462024-11-14T04:58:15.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132472024-11-14T04:58:15.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 355.045931ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
132482024-11-14T04:58:15.662ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
132492024-11-14T04:58:15.662ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
132502024-11-14T04:58:15.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
132512024-11-14T04:58:15.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
132522024-11-14T04:58:15.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132532024-11-14T04:58:15.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
132542024-11-14T04:58:15.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
132552024-11-14T04:58:15.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132562024-11-14T04:58:15.664ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
132572024-11-14T04:58:15.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
132582024-11-14T04:58:15.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
132592024-11-14T04:58:15.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
132602024-11-14T04:58:15.670ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
132612024-11-14T04:58:15.670ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 365.058782ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
132622024-11-14T04:58:15.674ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
132632024-11-14T04:58:15.674ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
132642024-11-14T04:58:15.674ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
132652024-11-14T04:58:15.674ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 369.453279ms iteration = 13 status = {"generation":2}
132662024-11-14T04:58:15.675ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
132672024-11-14T04:58:15.675ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
132682024-11-14T04:58:15.675ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
132692024-11-14T04:58:15.675ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 370.661204ms iteration = 13 status = {"generation":1}
132702024-11-14T04:58:15.679ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132712024-11-14T04:58:15.680ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
132722024-11-14T04:58:15.680ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 374.570617ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
132732024-11-14T04:58:15.686ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
132742024-11-14T04:58:15.686ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
132752024-11-14T04:58:15.686ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8afb27cb-f129-48d1-9686-d52ebaadf9ee", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
132762024-11-14T04:58:15.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132772024-11-14T04:58:15.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132782024-11-14T04:58:15.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132792024-11-14T04:58:15.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132802024-11-14T04:58:15.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132812024-11-14T04:58:15.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132822024-11-14T04:58:15.702ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
132832024-11-14T04:58:15.702ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
132842024-11-14T04:58:15.703ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0ee10993-404c-473b-a855-ba885982758e", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
132852024-11-14T04:58:15.704ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 399.169869ms iteration = 26 status = {}
132862024-11-14T04:58:15.728ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
132872024-11-14T04:58:15.728ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
132882024-11-14T04:58:15.729ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e1c2dd4-6485-48d8-bf66-7fa28e214522", "content-length": "26", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
132892024-11-14T04:58:15.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
132902024-11-14T04:58:15.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
132912024-11-14T04:58:15.736ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
132922024-11-14T04:58:15.736ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 431.248768ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
132932024-11-14T04:58:15.750ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 445.309425ms iteration = 28 status = {"physical_disks_added":0}
132942024-11-14T04:58:15.763ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
132952024-11-14T04:58:15.763ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "51cfef9b-bd56-4626-a121-802b5f16fff1", "content-length": "2", "date": "Thu, 14 Nov 2024 04:58:14 GMT"} })
132962024-11-14T04:58:15.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
132972024-11-14T04:58:15.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
132982024-11-14T04:58:15.768ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 463.309917ms iteration = 25 status = null
132992024-11-14T04:58:15.779ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
133002024-11-14T04:58:15.780ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f03f3f46-3694-4c7e-ac8f-03dd982dd42f", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
133012024-11-14T04:58:15.780ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
133022024-11-14T04:58:15.781ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "10a2e388-8f9f-4820-abc6-c00500f21dfb", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
133032024-11-14T04:58:15.781ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
133042024-11-14T04:58:15.783ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
133052024-11-14T04:58:15.783ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 478.061804ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
133062024-11-14T04:58:15.790ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
133072024-11-14T04:58:15.791ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "42265bc8-791e-4f8a-a010-f6d31d0bfeaf", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
133082024-11-14T04:58:15.791ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
133092024-11-14T04:58:15.793ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "530257ec-8446-4205-90d3-36eec39bd1a3", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
133102024-11-14T04:58:15.793ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
133112024-11-14T04:58:15.794ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fb7393b2-7ba2-4e48-9098-2d4463b1cebd", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
133122024-11-14T04:58:15.794ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
133132024-11-14T04:58:15.796ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
133142024-11-14T04:58:15.796ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 491.448051ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
133152024-11-14T04:58:15.818ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
133162024-11-14T04:58:15.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133172024-11-14T04:58:15.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133182024-11-14T04:58:15.884ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
133192024-11-14T04:58:15.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133202024-11-14T04:58:15.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133212024-11-14T04:58:15.894ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
133222024-11-14T04:58:15.895ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "953c31f5-975a-40f7-9b8d-3e939d5f18ab", "content-length": "134", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
133232024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
133242024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
133252024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
133262024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
133272024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
133282024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
133292024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
133302024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
133312024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
133322024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
133332024-11-14T04:58:15.895ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
133342024-11-14T04:58:15.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133352024-11-14T04:58:15.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133362024-11-14T04:58:15.898ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
133372024-11-14T04:58:15.898ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c076362-45e3-407e-b59d-54aa7b230604", "content-length": "2", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
133382024-11-14T04:58:15.898ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
133392024-11-14T04:58:15.898ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "31835146-26fd-4bbf-bfc8-dadcab1e3e32", "content-length": "51", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
133402024-11-14T04:58:15.898ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
133412024-11-14T04:58:15.898ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
133422024-11-14T04:58:15.923ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b3ed219-4c3e-4451-bb6d-01b21ac5a7b9", "content-length": "691", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
133432024-11-14T04:58:15.923ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
133442024-11-14T04:58:15.923ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
133452024-11-14T04:58:15.923ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
133462024-11-14T04:58:15.924ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 619.606613ms iteration = 26 status = {}
133472024-11-14T04:58:16.031ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "092bb80b-0a0f-4eb5-9411-8d2ac6ea9756", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
133482024-11-14T04:58:16.031ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
133492024-11-14T04:58:16.031ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
133502024-11-14T04:58:16.031ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a99b192-f261-43f1-8939-5477a54632d7", "content-length": "682", "date": "Thu, 14 Nov 2024 04:58:15 GMT"} })
133512024-11-14T04:58:16.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133522024-11-14T04:58:16.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133532024-11-14T04:58:16.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133542024-11-14T04:58:16.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133552024-11-14T04:58:16.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133562024-11-14T04:58:16.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133572024-11-14T04:58:16.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133582024-11-14T04:58:16.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133592024-11-14T04:58:16.049ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 743.622533ms iteration = 25 status = {}
133602024-11-14T04:58:16.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f36864db-4445-432e-b93f-2bbf2a8a2050 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133612024-11-14T04:58:16.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f36864db-4445-432e-b93f-2bbf2a8a2050 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133622024-11-14T04:58:16.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f36864db-4445-432e-b93f-2bbf2a8a2050 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133632024-11-14T04:58:17.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c81f5d40-31db-45f3-a17b-dff326d641ce roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133642024-11-14T04:58:17.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c81f5d40-31db-45f3-a17b-dff326d641ce resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133652024-11-14T04:58:17.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c81f5d40-31db-45f3-a17b-dff326d641ce response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133662024-11-14T04:58:18.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc79b5fb-3f1b-4752-ba87-1b9634f5ec79 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133672024-11-14T04:58:18.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc79b5fb-3f1b-4752-ba87-1b9634f5ec79 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133682024-11-14T04:58:18.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc79b5fb-3f1b-4752-ba87-1b9634f5ec79 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133692024-11-14T04:58:19.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9368f3b1-8297-40b0-87a9-6a45b8fafe0d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133702024-11-14T04:58:19.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9368f3b1-8297-40b0-87a9-6a45b8fafe0d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133712024-11-14T04:58:19.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9368f3b1-8297-40b0-87a9-6a45b8fafe0d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133722024-11-14T04:58:20.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 636 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 0329dc03-fc1c-42f8-8484-a5851b2598b1 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
133732024-11-14T04:58:20.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8a302ef3-86cf-421f-b30b-10eda6ac856e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133742024-11-14T04:58:20.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8a302ef3-86cf-421f-b30b-10eda6ac856e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133752024-11-14T04:58:20.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8a302ef3-86cf-421f-b30b-10eda6ac856e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133762024-11-14T04:58:21.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec7a576b-865f-440a-8b65-9b50a3a3bed4 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133772024-11-14T04:58:21.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec7a576b-865f-440a-8b65-9b50a3a3bed4 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133782024-11-14T04:58:21.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ec7a576b-865f-440a-8b65-9b50a3a3bed4 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133792024-11-14T04:58:22.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 832b4fce-3b84-4f8a-a68f-5e149a976e17 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133802024-11-14T04:58:22.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 832b4fce-3b84-4f8a-a68f-5e149a976e17 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133812024-11-14T04:58:22.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 832b4fce-3b84-4f8a-a68f-5e149a976e17 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133822024-11-14T04:58:23.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd2b543a-5708-42d1-b21e-f24835fca9f5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133832024-11-14T04:58:23.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd2b543a-5708-42d1-b21e-f24835fca9f5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133842024-11-14T04:58:23.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fd2b543a-5708-42d1-b21e-f24835fca9f5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133852024-11-14T04:58:24.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9333143-37d7-4ebe-b27d-b52712475478 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133862024-11-14T04:58:24.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9333143-37d7-4ebe-b27d-b52712475478 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133872024-11-14T04:58:24.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c9333143-37d7-4ebe-b27d-b52712475478 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
133882024-11-14T04:58:25.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
133892024-11-14T04:58:25.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133902024-11-14T04:58:25.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
133912024-11-14T04:58:25.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133922024-11-14T04:58:25.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133932024-11-14T04:58:25.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133942024-11-14T04:58:25.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133952024-11-14T04:58:25.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133962024-11-14T04:58:25.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133972024-11-14T04:58:25.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133982024-11-14T04:58:25.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133992024-11-14T04:58:25.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134002024-11-14T04:58:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134012024-11-14T04:58:25.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
134022024-11-14T04:58:25.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134032024-11-14T04:58:25.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134042024-11-14T04:58:25.327ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
134052024-11-14T04:58:25.327ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.769149ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
134062024-11-14T04:58:25.332ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134072024-11-14T04:58:25.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134082024-11-14T04:58:25.365ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.142851ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134092024-11-14T04:58:25.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fb05c4a3-b82a-4aa1-802a-da1637cc2210 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134102024-11-14T04:58:25.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fb05c4a3-b82a-4aa1-802a-da1637cc2210 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134112024-11-14T04:58:25.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fb05c4a3-b82a-4aa1-802a-da1637cc2210 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134122024-11-14T04:58:26.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0e33320-fb01-44f2-9213-8037bdd6f6b8 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134132024-11-14T04:58:26.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0e33320-fb01-44f2-9213-8037bdd6f6b8 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134142024-11-14T04:58:26.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2717 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e0e33320-fb01-44f2-9213-8037bdd6f6b8 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134152024-11-14T04:58:27.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 702a1f94-bf8d-4902-97d2-ed2160e13b93 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134162024-11-14T04:58:27.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 702a1f94-bf8d-4902-97d2-ed2160e13b93 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134172024-11-14T04:58:27.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 702a1f94-bf8d-4902-97d2-ed2160e13b93 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134182024-11-14T04:58:28.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ebe22530-ea24-4f3b-87f3-c879337aa573 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134192024-11-14T04:58:28.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ebe22530-ea24-4f3b-87f3-c879337aa573 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134202024-11-14T04:58:28.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ebe22530-ea24-4f3b-87f3-c879337aa573 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134212024-11-14T04:58:29.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 43425cca-60c1-411e-a211-06219e34faf5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134222024-11-14T04:58:29.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 43425cca-60c1-411e-a211-06219e34faf5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134232024-11-14T04:58:29.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 43425cca-60c1-411e-a211-06219e34faf5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134242024-11-14T04:58:30.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 68e8ed48-60b9-44de-98c3-14c5f0e6ce5f roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134252024-11-14T04:58:30.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 68e8ed48-60b9-44de-98c3-14c5f0e6ce5f resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134262024-11-14T04:58:30.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 68e8ed48-60b9-44de-98c3-14c5f0e6ce5f response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134272024-11-14T04:58:32.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d54e1190-2fe3-4d87-8992-b54700e25e95 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134282024-11-14T04:58:32.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d54e1190-2fe3-4d87-8992-b54700e25e95 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134292024-11-14T04:58:32.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d54e1190-2fe3-4d87-8992-b54700e25e95 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134302024-11-14T04:58:33.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7373b17e-c3be-43ed-8b37-39d66ce17d17 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134312024-11-14T04:58:33.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7373b17e-c3be-43ed-8b37-39d66ce17d17 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134322024-11-14T04:58:33.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7373b17e-c3be-43ed-8b37-39d66ce17d17 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134332024-11-14T04:58:34.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 86a076e3-21ee-4429-b11e-fd1927a999aa roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134342024-11-14T04:58:34.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 86a076e3-21ee-4429-b11e-fd1927a999aa resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134352024-11-14T04:58:34.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 86a076e3-21ee-4429-b11e-fd1927a999aa response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134362024-11-14T04:58:35.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df32d534-f76a-4666-be98-ab8eaf25021e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134372024-11-14T04:58:35.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df32d534-f76a-4666-be98-ab8eaf25021e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134382024-11-14T04:58:35.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = df32d534-f76a-4666-be98-ab8eaf25021e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134392024-11-14T04:58:35.256ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 4977a45b-8947-4dc0-ad25-1f98fdcbe9d2 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
134402024-11-14T04:58:35.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
134412024-11-14T04:58:35.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134422024-11-14T04:58:35.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
134432024-11-14T04:58:35.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134442024-11-14T04:58:35.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134452024-11-14T04:58:35.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134462024-11-14T04:58:35.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134472024-11-14T04:58:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134482024-11-14T04:58:35.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134492024-11-14T04:58:35.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134502024-11-14T04:58:35.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134512024-11-14T04:58:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134522024-11-14T04:58:35.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134532024-11-14T04:58:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
134542024-11-14T04:58:35.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134552024-11-14T04:58:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134562024-11-14T04:58:35.328ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
134572024-11-14T04:58:35.328ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.550682ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
134582024-11-14T04:58:35.335ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134592024-11-14T04:58:35.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134602024-11-14T04:58:35.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.42725ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134612024-11-14T04:58:36.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 05dac94d-ea2a-4e29-b3d7-33179345701d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134622024-11-14T04:58:36.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 05dac94d-ea2a-4e29-b3d7-33179345701d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134632024-11-14T04:58:36.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 05dac94d-ea2a-4e29-b3d7-33179345701d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134642024-11-14T04:58:37.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc48fc6a-77b4-47ba-a103-656110348f4c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134652024-11-14T04:58:37.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc48fc6a-77b4-47ba-a103-656110348f4c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134662024-11-14T04:58:37.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fc48fc6a-77b4-47ba-a103-656110348f4c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134672024-11-14T04:58:38.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5c6ba6f0-f651-4487-ab2b-6a664a031268 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134682024-11-14T04:58:38.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5c6ba6f0-f651-4487-ab2b-6a664a031268 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134692024-11-14T04:58:38.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5c6ba6f0-f651-4487-ab2b-6a664a031268 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134702024-11-14T04:58:39.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40b7ef00-07ab-46d1-bbe3-7ec9e7de15d7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134712024-11-14T04:58:39.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40b7ef00-07ab-46d1-bbe3-7ec9e7de15d7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134722024-11-14T04:58:39.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40b7ef00-07ab-46d1-bbe3-7ec9e7de15d7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134732024-11-14T04:58:40.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd67a20f-38d2-49ab-847a-6eaf4435b374 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134742024-11-14T04:58:40.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd67a20f-38d2-49ab-847a-6eaf4435b374 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134752024-11-14T04:58:40.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = dd67a20f-38d2-49ab-847a-6eaf4435b374 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134762024-11-14T04:58:41.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc038f27-c46e-48b5-aa1d-b57f34f3dfa3 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134772024-11-14T04:58:41.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc038f27-c46e-48b5-aa1d-b57f34f3dfa3 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134782024-11-14T04:58:41.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = bc038f27-c46e-48b5-aa1d-b57f34f3dfa3 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134792024-11-14T04:58:42.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f65ac5c2-b4dd-4916-8059-43cd961241c8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
134802024-11-14T04:58:42.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f65ac5c2-b4dd-4916-8059-43cd961241c8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
134812024-11-14T04:58:42.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = f65ac5c2-b4dd-4916-8059-43cd961241c8 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
134822024-11-14T04:58:42.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5f7f09d-b0fe-452a-b71d-05a4df7cac99 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134832024-11-14T04:58:42.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5f7f09d-b0fe-452a-b71d-05a4df7cac99 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134842024-11-14T04:58:42.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d5f7f09d-b0fe-452a-b71d-05a4df7cac99 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134852024-11-14T04:58:43.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ff005f9-7bd3-4a5c-9f5e-bca921016cd5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134862024-11-14T04:58:43.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ff005f9-7bd3-4a5c-9f5e-bca921016cd5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134872024-11-14T04:58:43.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4ff005f9-7bd3-4a5c-9f5e-bca921016cd5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134882024-11-14T04:58:44.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95989127-1c4d-4577-b6f7-e1ad73066bbc roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134892024-11-14T04:58:44.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95989127-1c4d-4577-b6f7-e1ad73066bbc resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134902024-11-14T04:58:44.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 95989127-1c4d-4577-b6f7-e1ad73066bbc response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
134912024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
134922024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134932024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
134942024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134952024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
134962024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
134972024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134982024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
134992024-11-14T04:58:45.304ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
135002024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135012024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
135022024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
135032024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
135042024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
135052024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135062024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
135072024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
135082024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
135092024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
135102024-11-14T04:58:45.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
135112024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
135122024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
135132024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
135142024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
135152024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135162024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
135172024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135182024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
135192024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
135202024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
135212024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
135222024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
135232024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135242024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
135252024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
135262024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
135272024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135282024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135292024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
135302024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135312024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135322024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
135332024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135342024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135352024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
135362024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135372024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
135382024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
135392024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
135402024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
135412024-11-14T04:58:45.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
135422024-11-14T04:58:45.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135432024-11-14T04:58:45.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.598813ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
135442024-11-14T04:58:45.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
135452024-11-14T04:58:45.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135462024-11-14T04:58:45.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135472024-11-14T04:58:45.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135482024-11-14T04:58:45.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135492024-11-14T04:58:45.311ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.371935ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
135502024-11-14T04:58:45.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135512024-11-14T04:58:45.313ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135522024-11-14T04:58:45.313ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
135532024-11-14T04:58:45.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135542024-11-14T04:58:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135552024-11-14T04:58:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
135562024-11-14T04:58:45.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135572024-11-14T04:58:45.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
135582024-11-14T04:58:45.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135592024-11-14T04:58:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135602024-11-14T04:58:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135612024-11-14T04:58:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
135622024-11-14T04:58:45.314ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135632024-11-14T04:58:45.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135642024-11-14T04:58:45.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135652024-11-14T04:58:45.317ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1704, tv_nsec: 95678833 } })
135662024-11-14T04:58:45.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
135672024-11-14T04:58:45.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135682024-11-14T04:58:45.318ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
135692024-11-14T04:58:45.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
135702024-11-14T04:58:45.318ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1704, tv_nsec: 96204889 } })
135712024-11-14T04:58:45.318ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
135722024-11-14T04:58:45.321ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135732024-11-14T04:58:45.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135742024-11-14T04:58:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
135752024-11-14T04:58:45.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135762024-11-14T04:58:45.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8879fe18-7227-48bd-b30e-e6771ca41bbb roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
135772024-11-14T04:58:45.322ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135782024-11-14T04:58:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135792024-11-14T04:58:45.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8879fe18-7227-48bd-b30e-e6771ca41bbb resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
135802024-11-14T04:58:45.323ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1704, tv_nsec: 101450421 } })
135812024-11-14T04:58:45.323ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
135822024-11-14T04:58:45.325ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135832024-11-14T04:58:45.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
135842024-11-14T04:58:45.328ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135852024-11-14T04:58:45.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
135862024-11-14T04:58:45.330ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135872024-11-14T04:58:45.330ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
135882024-11-14T04:58:45.330ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135892024-11-14T04:58:45.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135902024-11-14T04:58:45.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8879fe18-7227-48bd-b30e-e6771ca41bbb response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
135912024-11-14T04:58:45.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.98708ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
135922024-11-14T04:58:45.369ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135932024-11-14T04:58:45.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135942024-11-14T04:58:45.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
135952024-11-14T04:58:45.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
135962024-11-14T04:58:45.383ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
135972024-11-14T04:58:45.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
135982024-11-14T04:58:45.384ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135992024-11-14T04:58:45.385ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
136002024-11-14T04:58:45.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
136012024-11-14T04:58:45.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
136022024-11-14T04:58:45.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
136032024-11-14T04:58:45.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
136042024-11-14T04:58:45.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136052024-11-14T04:58:45.389ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136062024-11-14T04:58:45.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136072024-11-14T04:58:45.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
136082024-11-14T04:58:45.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136092024-11-14T04:58:45.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136102024-11-14T04:58:45.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136112024-11-14T04:58:45.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136122024-11-14T04:58:45.399ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
136132024-11-14T04:58:45.399ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
136142024-11-14T04:58:45.399ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.27831ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
136152024-11-14T04:58:45.407ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
136162024-11-14T04:58:45.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
136172024-11-14T04:58:45.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136182024-11-14T04:58:45.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
136192024-11-14T04:58:45.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136202024-11-14T04:58:45.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136212024-11-14T04:58:45.432ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
136222024-11-14T04:58:45.432ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 127.920495ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
136232024-11-14T04:58:45.438ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
136242024-11-14T04:58:45.438ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
136252024-11-14T04:58:45.438ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f17fcc2f-6516-426f-bc99-02ab057cb172", "content-length": "26", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
136262024-11-14T04:58:45.438ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
136272024-11-14T04:58:45.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 134.004291ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
136282024-11-14T04:58:45.441ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
136292024-11-14T04:58:45.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.445654ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
136302024-11-14T04:58:45.448ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
136312024-11-14T04:58:45.448ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
136322024-11-14T04:58:45.449ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9e94685-f4c9-4ee7-b62b-bce2fa6e4bf8", "content-length": "26", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
136332024-11-14T04:58:45.449ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
136342024-11-14T04:58:45.450ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
136352024-11-14T04:58:45.450ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 145.577506ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
136362024-11-14T04:58:45.451ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
136372024-11-14T04:58:45.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 150.493478ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
136382024-11-14T04:58:45.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136392024-11-14T04:58:45.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
136402024-11-14T04:58:45.471ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
136412024-11-14T04:58:45.471ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e62f94e1-fef6-4cb9-a714-d28a30650c01", "content-length": "26", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
136422024-11-14T04:58:45.472ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
136432024-11-14T04:58:45.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 167.251873ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
136442024-11-14T04:58:45.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
136452024-11-14T04:58:45.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136462024-11-14T04:58:45.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136472024-11-14T04:58:45.474ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
136482024-11-14T04:58:45.476ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 172.071733ms iteration = 26 status = 0
136492024-11-14T04:58:45.481ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136502024-11-14T04:58:45.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136512024-11-14T04:58:45.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136522024-11-14T04:58:45.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136532024-11-14T04:58:45.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136542024-11-14T04:58:45.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
136552024-11-14T04:58:45.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136562024-11-14T04:58:45.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136572024-11-14T04:58:45.501ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136582024-11-14T04:58:45.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
136592024-11-14T04:58:45.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136602024-11-14T04:58:45.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136612024-11-14T04:58:45.514ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.900379ms iteration = 29 status = {"physical_disks_added":0}
136622024-11-14T04:58:45.603ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
136632024-11-14T04:58:45.603ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1d2cfec-7bea-42eb-8897-c4dbf12d602f", "content-length": "2", "date": "Thu, 14 Nov 2024 04:58:44 GMT"} })
136642024-11-14T04:58:45.604ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
136652024-11-14T04:58:45.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
136662024-11-14T04:58:45.607ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 301.966595ms iteration = 26 status = null
136672024-11-14T04:58:45.677ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
136682024-11-14T04:58:45.688ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 383.837966ms iteration = 26 status = {}
136692024-11-14T04:58:45.742ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
136702024-11-14T04:58:45.742ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
136712024-11-14T04:58:45.762ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b640bb23-2562-49e5-9cfe-fcd83fbe9f6f", "content-length": "372", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
136722024-11-14T04:58:45.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136732024-11-14T04:58:45.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136742024-11-14T04:58:45.767ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1538d2d1-a301-44e8-81b2-2c65ec4da503", "content-length": "691", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
136752024-11-14T04:58:45.767ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
136762024-11-14T04:58:45.767ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
136772024-11-14T04:58:45.767ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
136782024-11-14T04:58:45.769ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 464.259644ms iteration = 27 status = {}
136792024-11-14T04:58:45.776ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
136802024-11-14T04:58:45.776ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
136812024-11-14T04:58:45.781ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6d2af314-89ee-4c36-b211-ef531fef5f5c", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
136822024-11-14T04:58:45.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136832024-11-14T04:58:45.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136842024-11-14T04:58:45.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136852024-11-14T04:58:45.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136862024-11-14T04:58:45.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136872024-11-14T04:58:45.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136882024-11-14T04:58:45.792ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
136892024-11-14T04:58:45.792ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
136902024-11-14T04:58:45.793ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "343db7d1-3f95-4e81-be91-17072725182f", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
136912024-11-14T04:58:45.795ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 490.604217ms iteration = 27 status = {}
136922024-11-14T04:58:45.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136932024-11-14T04:58:45.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136942024-11-14T04:58:45.801ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
136952024-11-14T04:58:45.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136962024-11-14T04:58:45.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136972024-11-14T04:58:45.811ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
136982024-11-14T04:58:45.811ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6197a224-47cf-4e59-af96-584309ef8285", "content-length": "134", "date": "Thu, 14 Nov 2024 04:58:44 GMT"} })
136992024-11-14T04:58:45.811ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
137002024-11-14T04:58:45.811ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
137012024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
137022024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
137032024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
137042024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
137052024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
137062024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
137072024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
137082024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
137092024-11-14T04:58:45.812ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
137102024-11-14T04:58:45.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137112024-11-14T04:58:45.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137122024-11-14T04:58:45.814ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
137132024-11-14T04:58:45.814ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdec7e78-6930-4a5d-8d56-104b9700b86e", "content-length": "2", "date": "Thu, 14 Nov 2024 04:58:44 GMT"} })
137142024-11-14T04:58:45.814ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
137152024-11-14T04:58:45.814ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a1f2dac-4411-4127-ac33-0f9889d0163f", "content-length": "51", "date": "Thu, 14 Nov 2024 04:58:44 GMT"} })
137162024-11-14T04:58:45.814ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
137172024-11-14T04:58:45.814ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
137182024-11-14T04:58:45.956ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "535209ca-3b46-4f51-a3b0-cf97ea19d4f0", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
137192024-11-14T04:58:45.956ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
137202024-11-14T04:58:45.956ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
137212024-11-14T04:58:45.957ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d22c650a-301f-4cd9-91a4-42ea9c31fd77", "content-length": "682", "date": "Thu, 14 Nov 2024 04:58:45 GMT"} })
137222024-11-14T04:58:45.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137232024-11-14T04:58:45.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137242024-11-14T04:58:45.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137252024-11-14T04:58:45.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137262024-11-14T04:58:45.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137272024-11-14T04:58:45.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137282024-11-14T04:58:45.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137292024-11-14T04:58:45.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137302024-11-14T04:58:45.973ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 668.165079ms iteration = 26 status = {}
137312024-11-14T04:58:46.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 043095c0-b6f3-4765-a686-f0d67ad74a25 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137322024-11-14T04:58:46.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 043095c0-b6f3-4765-a686-f0d67ad74a25 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137332024-11-14T04:58:46.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 043095c0-b6f3-4765-a686-f0d67ad74a25 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137342024-11-14T04:58:47.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c903458-8650-45eb-bab7-0cb74a0fe283 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137352024-11-14T04:58:47.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c903458-8650-45eb-bab7-0cb74a0fe283 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137362024-11-14T04:58:47.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c903458-8650-45eb-bab7-0cb74a0fe283 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137372024-11-14T04:58:48.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9732f183-8200-4322-9e82-a10840ef052e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137382024-11-14T04:58:48.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9732f183-8200-4322-9e82-a10840ef052e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137392024-11-14T04:58:48.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9732f183-8200-4322-9e82-a10840ef052e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137402024-11-14T04:58:49.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1a943e0-d5d0-4a69-836c-17cb752b960b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137412024-11-14T04:58:49.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1a943e0-d5d0-4a69-836c-17cb752b960b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137422024-11-14T04:58:49.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d1a943e0-d5d0-4a69-836c-17cb752b960b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137432024-11-14T04:58:50.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 603 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 47845f81-6233-4c82-806a-c5fb9fb8100d response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
137442024-11-14T04:58:50.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7696f03e-b19d-49b0-adeb-483f93cc8c92 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137452024-11-14T04:58:50.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7696f03e-b19d-49b0-adeb-483f93cc8c92 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137462024-11-14T04:58:50.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7696f03e-b19d-49b0-adeb-483f93cc8c92 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137472024-11-14T04:58:51.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4bc25858-8b02-45a0-ab95-dfd08552a9f0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137482024-11-14T04:58:51.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4bc25858-8b02-45a0-ab95-dfd08552a9f0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137492024-11-14T04:58:51.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4bc25858-8b02-45a0-ab95-dfd08552a9f0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137502024-11-14T04:58:52.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7fe09cc3-4eef-469e-8386-b10387c06f74 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137512024-11-14T04:58:52.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7fe09cc3-4eef-469e-8386-b10387c06f74 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137522024-11-14T04:58:52.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 7fe09cc3-4eef-469e-8386-b10387c06f74 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137532024-11-14T04:58:53.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 735c1ed6-c063-43c5-b963-d464d6b4fc1b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137542024-11-14T04:58:53.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 735c1ed6-c063-43c5-b963-d464d6b4fc1b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137552024-11-14T04:58:53.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 735c1ed6-c063-43c5-b963-d464d6b4fc1b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137562024-11-14T04:58:54.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6215064-77a7-40a0-847c-eb394c415682 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137572024-11-14T04:58:54.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6215064-77a7-40a0-847c-eb394c415682 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137582024-11-14T04:58:54.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c6215064-77a7-40a0-847c-eb394c415682 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137592024-11-14T04:58:55.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
137602024-11-14T04:58:55.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
137612024-11-14T04:58:55.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137622024-11-14T04:58:55.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137632024-11-14T04:58:55.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137642024-11-14T04:58:55.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137652024-11-14T04:58:55.307ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137662024-11-14T04:58:55.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137672024-11-14T04:58:55.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137682024-11-14T04:58:55.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137692024-11-14T04:58:55.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137702024-11-14T04:58:55.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137712024-11-14T04:58:55.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137722024-11-14T04:58:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
137732024-11-14T04:58:55.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137742024-11-14T04:58:55.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137752024-11-14T04:58:55.326ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
137762024-11-14T04:58:55.326ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.000498ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
137772024-11-14T04:58:55.334ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137782024-11-14T04:58:55.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137792024-11-14T04:58:55.336ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.963325ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137802024-11-14T04:58:55.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f828947b-f27d-420f-99bc-74010c039bd9 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137812024-11-14T04:58:55.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f828947b-f27d-420f-99bc-74010c039bd9 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137822024-11-14T04:58:55.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = f828947b-f27d-420f-99bc-74010c039bd9 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137832024-11-14T04:58:56.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 073c465c-67d9-4809-a7eb-45ef9ff4e163 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137842024-11-14T04:58:56.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 073c465c-67d9-4809-a7eb-45ef9ff4e163 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137852024-11-14T04:58:56.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 073c465c-67d9-4809-a7eb-45ef9ff4e163 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137862024-11-14T04:58:57.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4739d045-646d-4f40-83ae-bd6be3fe57af roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137872024-11-14T04:58:57.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4739d045-646d-4f40-83ae-bd6be3fe57af resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137882024-11-14T04:58:57.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4739d045-646d-4f40-83ae-bd6be3fe57af response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137892024-11-14T04:58:58.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7a4efcd-0d0e-4f04-80a8-d0fd154fb084 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137902024-11-14T04:58:58.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7a4efcd-0d0e-4f04-80a8-d0fd154fb084 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137912024-11-14T04:58:58.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = d7a4efcd-0d0e-4f04-80a8-d0fd154fb084 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137922024-11-14T04:58:59.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8de5abd7-7be1-4988-9b3b-5ac3c7e7ae8b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137932024-11-14T04:58:59.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8de5abd7-7be1-4988-9b3b-5ac3c7e7ae8b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137942024-11-14T04:58:59.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8de5abd7-7be1-4988-9b3b-5ac3c7e7ae8b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137952024-11-14T04:59:00.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4cabaaeb-2c5c-485c-9d63-728d13979051 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137962024-11-14T04:59:00.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4cabaaeb-2c5c-485c-9d63-728d13979051 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137972024-11-14T04:59:00.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 4cabaaeb-2c5c-485c-9d63-728d13979051 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137982024-11-14T04:59:01.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8584ca58-0049-4e67-bba7-9c90c88457a1 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
137992024-11-14T04:59:01.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8584ca58-0049-4e67-bba7-9c90c88457a1 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138002024-11-14T04:59:01.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 8584ca58-0049-4e67-bba7-9c90c88457a1 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138012024-11-14T04:59:02.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 60235104-c869-4a83-b009-e2836ad9a1d0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138022024-11-14T04:59:02.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 60235104-c869-4a83-b009-e2836ad9a1d0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138032024-11-14T04:59:02.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 60235104-c869-4a83-b009-e2836ad9a1d0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138042024-11-14T04:59:03.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 47fec28f-2125-4404-af59-c12ecf99ad1d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138052024-11-14T04:59:03.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 47fec28f-2125-4404-af59-c12ecf99ad1d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138062024-11-14T04:59:03.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 47fec28f-2125-4404-af59-c12ecf99ad1d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138072024-11-14T04:59:04.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5bc91a0f-b35f-4d52-9e84-7afd83638dd0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138082024-11-14T04:59:04.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5bc91a0f-b35f-4d52-9e84-7afd83638dd0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138092024-11-14T04:59:04.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5bc91a0f-b35f-4d52-9e84-7afd83638dd0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138102024-11-14T04:59:05.257ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 589 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 223d781e-8e0b-4e4a-abf7-dd0ea0fbe709 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
138112024-11-14T04:59:05.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
138122024-11-14T04:59:05.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
138132024-11-14T04:59:05.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138142024-11-14T04:59:05.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138152024-11-14T04:59:05.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138162024-11-14T04:59:05.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138172024-11-14T04:59:05.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138182024-11-14T04:59:05.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138192024-11-14T04:59:05.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138202024-11-14T04:59:05.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.307035ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
138212024-11-14T04:59:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
138222024-11-14T04:59:05.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138232024-11-14T04:59:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138242024-11-14T04:59:05.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138252024-11-14T04:59:05.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138262024-11-14T04:59:05.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138272024-11-14T04:59:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
138282024-11-14T04:59:05.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138292024-11-14T04:59:05.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138302024-11-14T04:59:05.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
138312024-11-14T04:59:05.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.563276ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
138322024-11-14T04:59:05.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea262c33-ff52-4df4-96cf-374c1641fb7d roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138332024-11-14T04:59:05.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea262c33-ff52-4df4-96cf-374c1641fb7d resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138342024-11-14T04:59:05.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = ea262c33-ff52-4df4-96cf-374c1641fb7d response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138352024-11-14T04:59:06.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b9d563a-5e2c-418c-9d4f-58b0d6dd2061 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138362024-11-14T04:59:06.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b9d563a-5e2c-418c-9d4f-58b0d6dd2061 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138372024-11-14T04:59:06.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 2b9d563a-5e2c-418c-9d4f-58b0d6dd2061 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138382024-11-14T04:59:07.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c08d2eed-f79a-48c4-9313-c1f34e5e983b roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138392024-11-14T04:59:07.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c08d2eed-f79a-48c4-9313-c1f34e5e983b resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138402024-11-14T04:59:07.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = c08d2eed-f79a-48c4-9313-c1f34e5e983b response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138412024-11-14T04:59:08.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fefaf2bf-203b-40fa-b9a5-c98df3ef776c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138422024-11-14T04:59:08.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fefaf2bf-203b-40fa-b9a5-c98df3ef776c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138432024-11-14T04:59:08.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fefaf2bf-203b-40fa-b9a5-c98df3ef776c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138442024-11-14T04:59:09.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fabbee50-8a17-491e-9937-d16a5a18df8c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138452024-11-14T04:59:09.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fabbee50-8a17-491e-9937-d16a5a18df8c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138462024-11-14T04:59:09.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fabbee50-8a17-491e-9937-d16a5a18df8c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138472024-11-14T04:59:10.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = c648363e-fe68-442e-931a-c02cdab1ea5e roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
138482024-11-14T04:59:10.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = c648363e-fe68-442e-931a-c02cdab1ea5e resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
138492024-11-14T04:59:10.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = c648363e-fe68-442e-931a-c02cdab1ea5e response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?sort_by=id_ascending
138502024-11-14T04:59:10.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 4845fe86-ba45-4c39-8423-7967a0304cb6 roles = RoleSet { roles: {} } uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
138512024-11-14T04:59:10.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 4845fe86-ba45-4c39-8423-7967a0304cb6 resource = Database result = Ok(()) uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
138522024-11-14T04:59:10.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49358 req_id = 4845fe86-ba45-4c39-8423-7967a0304cb6 response_code = 200 uri = /metrics/collectors/459b411b-9021-43ae-8875-254e55794157/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNGM4ZjMzMC05MWQ2LTQ5NzYtYjYzNy1jNzJmOTAwZDhjODcifX0%3D
138532024-11-14T04:59:10.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3dc9f3b1-2e5f-4cd2-b53c-ea99e79bc026 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138542024-11-14T04:59:10.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3dc9f3b1-2e5f-4cd2-b53c-ea99e79bc026 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138552024-11-14T04:59:10.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3dc9f3b1-2e5f-4cd2-b53c-ea99e79bc026 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138562024-11-14T04:59:11.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 09e0e8ed-d7d9-4579-a092-e16e269dcc25 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138572024-11-14T04:59:11.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 09e0e8ed-d7d9-4579-a092-e16e269dcc25 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138582024-11-14T04:59:11.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 09e0e8ed-d7d9-4579-a092-e16e269dcc25 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138592024-11-14T04:59:12.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c4406bd0-157f-4aa6-8ee6-0bc099daab6b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
138602024-11-14T04:59:12.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c4406bd0-157f-4aa6-8ee6-0bc099daab6b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
138612024-11-14T04:59:12.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47105 req_id = c4406bd0-157f-4aa6-8ee6-0bc099daab6b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
138622024-11-14T04:59:12.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40ecd50f-437f-4e38-bf59-29464c74bfe5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138632024-11-14T04:59:12.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40ecd50f-437f-4e38-bf59-29464c74bfe5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138642024-11-14T04:59:13.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 40ecd50f-437f-4e38-bf59-29464c74bfe5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138652024-11-14T04:59:14.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 506596b1-d91c-4f31-8438-9b46ad48f463 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138662024-11-14T04:59:14.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 506596b1-d91c-4f31-8438-9b46ad48f463 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138672024-11-14T04:59:14.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 506596b1-d91c-4f31-8438-9b46ad48f463 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138682024-11-14T04:59:15.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5060aea2-2023-4eca-b3a3-50ddc39f44d2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138692024-11-14T04:59:15.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5060aea2-2023-4eca-b3a3-50ddc39f44d2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138702024-11-14T04:59:15.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5060aea2-2023-4eca-b3a3-50ddc39f44d2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
138712024-11-14T04:59:15.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
138722024-11-14T04:59:15.304ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
138732024-11-14T04:59:15.304ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
138742024-11-14T04:59:15.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138752024-11-14T04:59:15.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
138762024-11-14T04:59:15.304ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
138772024-11-14T04:59:15.304ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
138782024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
138792024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138802024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
138812024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
138822024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
138832024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
138842024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138852024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
138862024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
138872024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
138882024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
138892024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
138902024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
138912024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138922024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
138932024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
138942024-11-14T04:59:15.305ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 04:49:15.305074832 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
138952024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
138962024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138972024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
138982024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
138992024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
139002024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
139012024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
139022024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
139032024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
139042024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
139052024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
139062024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
139072024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
139082024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
139092024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
139102024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
139112024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
139122024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
139132024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139142024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
139152024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
139162024-11-14T04:59:15.305ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
139172024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
139182024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139192024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139202024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
139212024-11-14T04:59:15.305ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
139222024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
139232024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
139242024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
139252024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
139262024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
139272024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
139282024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
139292024-11-14T04:59:15.305ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7
139302024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.341\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7"}
139312024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
139322024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139332024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
139342024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
139352024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139362024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
139372024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
139382024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
139392024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
139402024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
139412024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139422024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
139432024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139442024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
139452024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139462024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139472024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
139482024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
139492024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
139502024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
139512024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
139522024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
139532024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
139542024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139552024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139562024-11-14T04:59:15.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139572024-11-14T04:59:15.305ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2327cea1-dd20-406b-af0b-11f432f90f24.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("24da292b-72a6-4c9f-b124-daf5b3ed05d9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b0f17ac9-6497-4365-ae94-118450acb817.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1734, tv_nsec: 83853859 } })
139582024-11-14T04:59:15.305ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48221b8a-d832-4d05-ae47-e92f81388c0c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8c0d54f6-76b3-47cc-9828-b8e677cc2961.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1734, tv_nsec: 83984593 } })
139592024-11-14T04:59:15.306ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
139602024-11-14T04:59:15.306ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
139612024-11-14T04:59:15.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.434542ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
139622024-11-14T04:59:15.306ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.101162ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
139632024-11-14T04:59:15.307ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1734, tv_nsec: 85557279 } })
139642024-11-14T04:59:15.307ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
139652024-11-14T04:59:15.308ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139662024-11-14T04:59:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139672024-11-14T04:59:15.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
139682024-11-14T04:59:15.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
139692024-11-14T04:59:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.701457ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
139702024-11-14T04:59:15.308ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.837591ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
139712024-11-14T04:59:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.758998ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
139722024-11-14T04:59:15.309ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139732024-11-14T04:59:15.309ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
139742024-11-14T04:59:15.309ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
139752024-11-14T04:59:15.309ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.937653ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
139762024-11-14T04:59:15.310ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 04:49:15.305074832 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
139772024-11-14T04:59:15.310ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.761637ms iteration = 14 status = {"expiration":"2024-11-14T04:49:15.305074832Z","pruned":[]}
139782024-11-14T04:59:15.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139792024-11-14T04:59:15.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139802024-11-14T04:59:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
139812024-11-14T04:59:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
139822024-11-14T04:59:15.311ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
139832024-11-14T04:59:15.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
139842024-11-14T04:59:15.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
139852024-11-14T04:59:15.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
139862024-11-14T04:59:15.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139872024-11-14T04:59:15.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139882024-11-14T04:59:15.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139892024-11-14T04:59:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139902024-11-14T04:59:15.314ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139912024-11-14T04:59:15.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139922024-11-14T04:59:15.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139932024-11-14T04:59:15.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
139942024-11-14T04:59:15.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
139952024-11-14T04:59:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
139962024-11-14T04:59:15.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139972024-11-14T04:59:15.316ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
139982024-11-14T04:59:15.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
139992024-11-14T04:59:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140002024-11-14T04:59:15.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
140012024-11-14T04:59:15.318ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140022024-11-14T04:59:15.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140032024-11-14T04:59:15.320ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1734, tv_nsec: 98808042 } })
140042024-11-14T04:59:15.321ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
140052024-11-14T04:59:15.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
140062024-11-14T04:59:15.321ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
140072024-11-14T04:59:15.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
140082024-11-14T04:59:15.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
140092024-11-14T04:59:15.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140102024-11-14T04:59:15.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140112024-11-14T04:59:15.323ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140122024-11-14T04:59:15.324ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 19.542366ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
140132024-11-14T04:59:15.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140142024-11-14T04:59:15.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
140152024-11-14T04:59:15.326ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140162024-11-14T04:59:15.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140172024-11-14T04:59:15.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
140182024-11-14T04:59:15.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140192024-11-14T04:59:15.330ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c073d51c-abaa-48df-abb6-2f053e9c1bec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1734, tv_nsec: 108791221 } })
140202024-11-14T04:59:15.331ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
140212024-11-14T04:59:15.331ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140222024-11-14T04:59:15.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140232024-11-14T04:59:15.332ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140242024-11-14T04:59:15.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140252024-11-14T04:59:15.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
140262024-11-14T04:59:15.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
140272024-11-14T04:59:15.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
140282024-11-14T04:59:15.335ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140292024-11-14T04:59:15.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140302024-11-14T04:59:15.344ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140312024-11-14T04:59:15.344ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140322024-11-14T04:59:15.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
140332024-11-14T04:59:15.347ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140342024-11-14T04:59:15.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140352024-11-14T04:59:15.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
140362024-11-14T04:59:15.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
140372024-11-14T04:59:15.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
140382024-11-14T04:59:15.369ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140392024-11-14T04:59:15.369ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
140402024-11-14T04:59:15.369ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140412024-11-14T04:59:15.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140422024-11-14T04:59:15.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
140432024-11-14T04:59:15.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
140442024-11-14T04:59:15.384ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
140452024-11-14T04:59:15.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
140462024-11-14T04:59:15.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140472024-11-14T04:59:15.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140482024-11-14T04:59:15.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140492024-11-14T04:59:15.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
140502024-11-14T04:59:15.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
140512024-11-14T04:59:15.420ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 115.183346ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
140522024-11-14T04:59:15.420ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
140532024-11-14T04:59:15.420ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 115.393752ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
140542024-11-14T04:59:15.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
140552024-11-14T04:59:15.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140562024-11-14T04:59:15.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140572024-11-14T04:59:15.422ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
140582024-11-14T04:59:15.422ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
140592024-11-14T04:59:15.422ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.958457ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
140602024-11-14T04:59:15.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140612024-11-14T04:59:15.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140622024-11-14T04:59:15.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140632024-11-14T04:59:15.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c073d51c-abaa-48df-abb6-2f053e9c1bec, lookup_type: ById(c073d51c-abaa-48df-abb6-2f053e9c1bec) } result = Ok(())
140642024-11-14T04:59:15.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140652024-11-14T04:59:15.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140662024-11-14T04:59:15.432ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
140672024-11-14T04:59:15.432ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
140682024-11-14T04:59:15.432ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
140692024-11-14T04:59:15.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
140702024-11-14T04:59:15.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
140712024-11-14T04:59:15.433ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 128.698537ms iteration = 27 status = 0
140722024-11-14T04:59:15.434ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
140732024-11-14T04:59:15.434ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
140742024-11-14T04:59:15.434ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
140752024-11-14T04:59:15.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
140762024-11-14T04:59:15.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
140772024-11-14T04:59:15.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140782024-11-14T04:59:15.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140792024-11-14T04:59:15.436ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
140802024-11-14T04:59:15.436ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 131.91801ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
140812024-11-14T04:59:15.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
140822024-11-14T04:59:15.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
140832024-11-14T04:59:15.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
140842024-11-14T04:59:15.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
140852024-11-14T04:59:15.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
140862024-11-14T04:59:15.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
140872024-11-14T04:59:15.442ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
140882024-11-14T04:59:15.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
140892024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
140902024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
140912024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
140922024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
140932024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 0 version = 2
140942024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
140952024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
140962024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
140972024-11-14T04:59:15.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
140982024-11-14T04:59:15.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
140992024-11-14T04:59:15.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141002024-11-14T04:59:15.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141012024-11-14T04:59:15.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141022024-11-14T04:59:15.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
141032024-11-14T04:59:15.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
141042024-11-14T04:59:15.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
141052024-11-14T04:59:15.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
141062024-11-14T04:59:15.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
141072024-11-14T04:59:15.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
141082024-11-14T04:59:15.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
141092024-11-14T04:59:15.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141102024-11-14T04:59:15.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141112024-11-14T04:59:15.461ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 823c13bf-5aec-4696-b1d5-c0aaf2fd3470 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
141122024-11-14T04:59:15.461ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
141132024-11-14T04:59:15.461ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 04:46:16.023652 UTC dns_group = internal generation = 1
141142024-11-14T04:59:15.461ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 156.08238ms iteration = 14 status = {"generation":1}
141152024-11-14T04:59:15.471ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 471521d2-c589-429d-b7c5-a658396cfcf6 dns_zone_name = oxide.test found_so_far = 1 version = 2
141162024-11-14T04:59:15.471ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
141172024-11-14T04:59:15.471ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 04:46:18.039899 UTC dns_group = external generation = 2
141182024-11-14T04:59:15.471ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 166.384688ms iteration = 14 status = {"generation":2}
141192024-11-14T04:59:15.477ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
141202024-11-14T04:59:15.477ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
141212024-11-14T04:59:15.477ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
141222024-11-14T04:59:15.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
141232024-11-14T04:59:15.478ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 173.109863ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
141242024-11-14T04:59:15.481ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
141252024-11-14T04:59:15.481ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
141262024-11-14T04:59:15.481ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 176.287525ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
141272024-11-14T04:59:15.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 181.616419ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
141282024-11-14T04:59:15.488ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
141292024-11-14T04:59:15.488ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 183.108103ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
141302024-11-14T04:59:15.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 197.608002ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
141312024-11-14T04:59:15.504ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141322024-11-14T04:59:15.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
141332024-11-14T04:59:15.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
141342024-11-14T04:59:15.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
141352024-11-14T04:59:15.530ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 zone_address = fd00:1122:3344:101::2
141362024-11-14T04:59:15.530ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
141372024-11-14T04:59:15.530ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "760d7359-a840-4439-b210-f7380a5f6fe5", "content-length": "26", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
141382024-11-14T04:59:15.530ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
141392024-11-14T04:59:15.532ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f971eb12-0fea-4084-96d3-74198bddd289
141402024-11-14T04:59:15.533ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
141412024-11-14T04:59:15.533ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
141422024-11-14T04:59:15.534ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7d00c9b-763c-4d56-a335-31dfb214a8df", "content-length": "26", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
141432024-11-14T04:59:15.534ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
141442024-11-14T04:59:15.534ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
141452024-11-14T04:59:15.536ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
141462024-11-14T04:59:15.546ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.730962ms iteration = 30 status = {"physical_disks_added":0}
141472024-11-14T04:59:15.546ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141482024-11-14T04:59:15.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141492024-11-14T04:59:15.548ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T04:46:10.019708Z, time_modified: 2024-11-14T04:46:10.019708Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 992dae43-7740-49b5-814b-c5341916fc63, db_silo: Silo { identity: SiloIdentity { id: 992dae43-7740-49b5-814b-c5341916fc63, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T04:46:17.991199Z, time_modified: 2024-11-14T04:46:17.991199Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f" }] }) }
141502024-11-14T04:59:15.548ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 243.08124ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]}},"default_endpoint":{"silo_id":"992dae43-7740-49b5-814b-c5341916fc63","tls_certs":["b8a326130f7feb180d822bab9229e903b08dd160da401fae1aa501ed8531f09f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
141512024-11-14T04:59:15.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
141522024-11-14T04:59:15.625ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
141532024-11-14T04:59:15.625ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dfd230e-3fd0-47c0-98d4-d57c0629c3ba", "content-length": "26", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
141542024-11-14T04:59:15.625ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
141552024-11-14T04:59:15.629ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
141562024-11-14T04:59:15.635ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
141572024-11-14T04:59:15.688ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141582024-11-14T04:59:15.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141592024-11-14T04:59:15.691ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141602024-11-14T04:59:15.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141612024-11-14T04:59:15.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141622024-11-14T04:59:15.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141632024-11-14T04:59:15.767ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
141642024-11-14T04:59:15.768ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3e10e1f-c4ea-451c-b176-541a9ca219dd", "content-length": "2", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
141652024-11-14T04:59:15.769ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
141662024-11-14T04:59:15.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
141672024-11-14T04:59:15.774ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
141682024-11-14T04:59:15.774ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
141692024-11-14T04:59:15.774ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "210cc13a-1d2e-4383-86c5-41f2dd3a696e", "content-length": "372", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
141702024-11-14T04:59:15.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141712024-11-14T04:59:15.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141722024-11-14T04:59:15.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141732024-11-14T04:59:15.777ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 472.278797ms iteration = 27 status = null
141742024-11-14T04:59:15.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141752024-11-14T04:59:15.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141762024-11-14T04:59:15.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141772024-11-14T04:59:15.791ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
141782024-11-14T04:59:15.791ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
141792024-11-14T04:59:15.791ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "635d4ba2-a659-4328-8246-1b786f9db153", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
141802024-11-14T04:59:15.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141812024-11-14T04:59:15.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141822024-11-14T04:59:15.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141832024-11-14T04:59:15.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141842024-11-14T04:59:15.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141852024-11-14T04:59:15.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141862024-11-14T04:59:15.800ZINFOnexus (BackgroundTasks): VPC route manager sled c073d51c-abaa-48df-abb6-2f053e9c1bec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
141872024-11-14T04:59:15.800ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
141882024-11-14T04:59:15.800ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5efca013-1a0f-4abe-8dc1-00b1deed5e3e", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
141892024-11-14T04:59:15.802ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 497.25453ms iteration = 28 status = {}
141902024-11-14T04:59:15.819ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 514.383226ms iteration = 27 status = {}
141912024-11-14T04:59:15.823ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
141922024-11-14T04:59:15.823ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
141932024-11-14T04:59:15.823ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "23ecd34b-7089-4068-b9b0-35b9abff8ff7", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
141942024-11-14T04:59:15.823ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
141952024-11-14T04:59:15.825ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ad2a1856-4eaa-4d5e-b6f4-6d03622c4fbd", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
141962024-11-14T04:59:15.825ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
141972024-11-14T04:59:15.827ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
141982024-11-14T04:59:15.827ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 522.14728ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
141992024-11-14T04:59:15.870ZDEBGnexus (BackgroundTasks): client request SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
142002024-11-14T04:59:15.871ZDEBGnexus (BackgroundTasks): client response SledAgent = c073d51c-abaa-48df-abb6-2f053e9c1bec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cae10141-f5a7-4c40-a189-6b7383a46918", "content-length": "691", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
142012024-11-14T04:59:15.871ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
142022024-11-14T04:59:15.871ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
142032024-11-14T04:59:15.871ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
142042024-11-14T04:59:15.873ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 568.178254ms iteration = 28 status = {}
142052024-11-14T04:59:15.885ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
142062024-11-14T04:59:15.885ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7856d941-a5b2-4268-85fb-5240eb489ba1", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142072024-11-14T04:59:15.885ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142082024-11-14T04:59:15.887ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d74a6054-9161-4df9-bc67-6f986a73eeb3", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142092024-11-14T04:59:15.887ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142102024-11-14T04:59:15.888ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6ae97852-e189-42e6-8243-0a82242bc968", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142112024-11-14T04:59:15.888ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142122024-11-14T04:59:15.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142132024-11-14T04:59:15.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142142024-11-14T04:59:15.890ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
142152024-11-14T04:59:15.890ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 585.611369ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
142162024-11-14T04:59:15.892ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7a4d1fda-a07d-4bbb-b64b-95a0877b4ce5, rack_id: f971eb12-0fea-4084-96d3-74198bddd289, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cd4e4950-ced0-45b6-a0d9-7018602e099c) } rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
142172024-11-14T04:59:15.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142182024-11-14T04:59:15.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142192024-11-14T04:59:15.901ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
142202024-11-14T04:59:15.902ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "be9dbdd7-046e-41dd-b6ad-043f1508c3dd", "content-length": "134", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
142212024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
142222024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cd4e4950-ced0-45b6-a0d9-7018602e099c
142232024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
142242024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
142252024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
142262024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
142272024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
142282024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
142292024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
142302024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
142312024-11-14T04:59:15.902ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = f971eb12-0fea-4084-96d3-74198bddd289
142322024-11-14T04:59:15.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142332024-11-14T04:59:15.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142342024-11-14T04:59:15.904ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
142352024-11-14T04:59:15.905ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f197515a-f153-4fee-b90a-4d11c20b55a5", "content-length": "2", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
142362024-11-14T04:59:15.905ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
142372024-11-14T04:59:15.905ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "70c14b74-9eec-49e5-9a34-5efc769577b4", "content-length": "51", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
142382024-11-14T04:59:15.905ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch_location = Switch0
142392024-11-14T04:59:15.905ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
142402024-11-14T04:59:16.018ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b1c9648d-9b98-4476-88e8-9e8e5a2e95c1", "date": "Thu, 14 Nov 2024 04:59:15 GMT"} })
142412024-11-14T04:59:16.018ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = f971eb12-0fea-4084-96d3-74198bddd289 switch = Switch0
142422024-11-14T04:59:16.018ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f971eb12-0fea-4084-96d3-74198bddd289 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
142432024-11-14T04:59:16.018ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f971eb12-0fea-4084-96d3-74198bddd289 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb3218d4-35e1-4037-8ac7-71666bb77d61", "content-length": "682", "date": "Thu, 14 Nov 2024 04:59:16 GMT"} })
142442024-11-14T04:59:16.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142452024-11-14T04:59:16.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142462024-11-14T04:59:16.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142472024-11-14T04:59:16.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142482024-11-14T04:59:16.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142492024-11-14T04:59:16.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142502024-11-14T04:59:16.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142512024-11-14T04:59:16.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142522024-11-14T04:59:16.035ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 730.662819ms iteration = 27 status = {}
142532024-11-14T04:59:16.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c6fe46d-90db-4c66-b540-e267cb4e6868 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142542024-11-14T04:59:16.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c6fe46d-90db-4c66-b540-e267cb4e6868 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142552024-11-14T04:59:16.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1c6fe46d-90db-4c66-b540-e267cb4e6868 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142562024-11-14T04:59:17.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 613eee5d-adb0-46c7-a2e0-3370071e7f53 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142572024-11-14T04:59:17.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 613eee5d-adb0-46c7-a2e0-3370071e7f53 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142582024-11-14T04:59:17.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 613eee5d-adb0-46c7-a2e0-3370071e7f53 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142592024-11-14T04:59:18.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a8f743f6-355f-45f5-8b99-54bd87e1c072 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142602024-11-14T04:59:18.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a8f743f6-355f-45f5-8b99-54bd87e1c072 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142612024-11-14T04:59:18.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = a8f743f6-355f-45f5-8b99-54bd87e1c072 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142622024-11-14T04:59:19.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e8e75a7-33e8-45fe-a571-6e9db645d963 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142632024-11-14T04:59:19.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e8e75a7-33e8-45fe-a571-6e9db645d963 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142642024-11-14T04:59:19.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 5e8e75a7-33e8-45fe-a571-6e9db645d963 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142652024-11-14T04:59:20.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6b841299-d755-4a38-bf50-4cb7cf6c6c82 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142662024-11-14T04:59:20.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6b841299-d755-4a38-bf50-4cb7cf6c6c82 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142672024-11-14T04:59:20.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 6b841299-d755-4a38-bf50-4cb7cf6c6c82 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142682024-11-14T04:59:20.255ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 531 local_addr = [fd00:1122:3344:101::c]:61320 method = GET remote_addr = [fd00:1122:3344:101::d]:62170 req_id = 857ee77d-02f7-466b-8e95-5b3cd78a1595 response_code = 200 uri = /79994e02-6747-4071-83af-7872b31640fb
142692024-11-14T04:59:21.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1638979d-fa81-4f0e-961f-a12763e0509c roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142702024-11-14T04:59:21.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1638979d-fa81-4f0e-961f-a12763e0509c resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142712024-11-14T04:59:21.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 1638979d-fa81-4f0e-961f-a12763e0509c response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142722024-11-14T04:59:22.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e2a3aee5-644a-47d9-b4af-a5a0866f7d88 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142732024-11-14T04:59:22.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e2a3aee5-644a-47d9-b4af-a5a0866f7d88 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142742024-11-14T04:59:22.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = e2a3aee5-644a-47d9-b4af-a5a0866f7d88 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142752024-11-14T04:59:23.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fa20fdeb-3091-45aa-9878-f17a795c88f2 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142762024-11-14T04:59:23.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fa20fdeb-3091-45aa-9878-f17a795c88f2 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142772024-11-14T04:59:23.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = fa20fdeb-3091-45aa-9878-f17a795c88f2 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142782024-11-14T04:59:24.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9f4b17b0-ea60-4255-aad9-13a406b52869 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142792024-11-14T04:59:24.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9f4b17b0-ea60-4255-aad9-13a406b52869 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142802024-11-14T04:59:24.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9f4b17b0-ea60-4255-aad9-13a406b52869 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142812024-11-14T04:59:25.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e84403b-8c21-4526-98a8-2f35dadee4c7 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142822024-11-14T04:59:25.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e84403b-8c21-4526-98a8-2f35dadee4c7 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142832024-11-14T04:59:25.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 3e84403b-8c21-4526-98a8-2f35dadee4c7 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
142842024-11-14T04:59:25.304ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
142852024-11-14T04:59:25.304ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
142862024-11-14T04:59:25.304ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142872024-11-14T04:59:25.304ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142882024-11-14T04:59:25.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142892024-11-14T04:59:25.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142902024-11-14T04:59:25.306ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142912024-11-14T04:59:25.307ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142922024-11-14T04:59:25.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142932024-11-14T04:59:25.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142942024-11-14T04:59:25.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.759748ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142952024-11-14T04:59:25.309ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142962024-11-14T04:59:25.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142972024-11-14T04:59:25.311ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142982024-11-14T04:59:25.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142992024-11-14T04:59:25.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143002024-11-14T04:59:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 601475e8-5db8-414f-91f2-d6124fa0dcd7, lookup_type: ById(601475e8-5db8-414f-91f2-d6124fa0dcd7) } result = Ok(())
143012024-11-14T04:59:25.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143022024-11-14T04:59:25.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143032024-11-14T04:59:25.324ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 original_time_created = 2024-11-14 04:46:04.796077 UTC target_id = 601475e8-5db8-414f-91f2-d6124fa0dcd7 time_created = 2024-11-14 04:46:04.796077 UTC
143042024-11-14T04:59:25.324ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.629259ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"601475e8-5db8-414f-91f2-d6124fa0dcd7","time_created":"2024-11-14T04:46:04.796077Z"}
143052024-11-14T04:59:26.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 00208a98-b158-47b6-94b7-63d562706384 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143062024-11-14T04:59:26.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 00208a98-b158-47b6-94b7-63d562706384 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143072024-11-14T04:59:26.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 00208a98-b158-47b6-94b7-63d562706384 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143082024-11-14T04:59:27.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9e410375-7ddf-4b94-a1ba-f3b08f8d04c0 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143092024-11-14T04:59:27.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9e410375-7ddf-4b94-a1ba-f3b08f8d04c0 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143102024-11-14T04:59:27.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 9e410375-7ddf-4b94-a1ba-f3b08f8d04c0 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143112024-11-14T04:59:28.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 497504d0-e586-4688-ac0b-9b986fa3ccb5 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143122024-11-14T04:59:28.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 497504d0-e586-4688-ac0b-9b986fa3ccb5 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143132024-11-14T04:59:28.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 497504d0-e586-4688-ac0b-9b986fa3ccb5 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143142024-11-14T04:59:29.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69b20c01-f75b-4b24-821c-8242b3759670 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143152024-11-14T04:59:29.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69b20c01-f75b-4b24-821c-8242b3759670 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143162024-11-14T04:59:29.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 69b20c01-f75b-4b24-821c-8242b3759670 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143172024-11-14T04:59:30.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 17fd260e-8998-4fd2-8cab-b1185c9c8945 roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143182024-11-14T04:59:30.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 17fd260e-8998-4fd2-8cab-b1185c9c8945 resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143192024-11-14T04:59:30.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 17fd260e-8998-4fd2-8cab-b1185c9c8945 response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143202024-11-14T04:59:31.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 433a28e4-b5ac-4b9a-ab22-84429cb0302e roles = RoleSet { roles: {} } uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143212024-11-14T04:59:31.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 433a28e4-b5ac-4b9a-ab22-84429cb0302e resource = Database result = Ok(()) uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec
143222024-11-14T04:59:31.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62954 req_id = 433a28e4-b5ac-4b9a-ab22-84429cb0302e response_code = 200 uri = /probes/c073d51c-abaa-48df-abb6-2f053e9c1bec